Local Government 
Management Project 


Series B Publications 
Technical Papers 


a 
2 i 


> ~ } 
W Pali as 
Wo og W 


ULMER 


3 1761 12059852 9 


Py sa Gy 


W xs > 


Cs 


Improving 
Management 
Performance: 


The Contribution of Productivity 
and Performance Measurement 


V.N. MacDonald 
P.J. Lawton 


Local Government 
Management Project 


Series B Publications 
Technical Papers 


November, 1977 


Improving 
Management 
Performance: 


The Contribution of Productivity 
and Performance Measurement 


V.N. MacDonald 
P.J. Lawton 


This Publication has been Prepared as Part of 
The Local Government Management Project 


A Joint Project of 


The Ministry of Treasury, Economics and Inter- 
governmental Affairs, Province of Ontario 


The Cities of London, Ottawa, and St. Catharines and 
The Regional Municipality of Niagara 


The School of Business, Queen’s University at Kingston 


Price $5.00 © Crown Copyright Reserved Painted by Hanson & Edgar — Kingston 


Preface 


The Local Government Management Project (LGMP) is 
a long-term experimental project to research methods 
of improving management in local government. It is 
jointly sponsored by the Province of Ontario and four 
Ontario municipalities. The Project was designed, im- 
plemented, documented and evaluated by a Project 
Team from Queen’s University assisted by Project 
Leaders (internal facilitators) in each of the participat- 
ing municipalities. 


The events and experiences that occurred as the four 
municipalities applied new management practices to 
their operations, have been documented in detail. Les- 
sons from those experiences have also been extensively 
documented and evaluated. Papers containing both the 
history and the evaluation are published at intervals, as 
the Project progresses, under the general documenta- 
tion heading of ‘Series A Publications: Documentation 
and Evaluation’. 


As the Project developed, however, it was realized that 
there were certain aspects of management improvement 
that should be covered in greater depth under specific 
headings. Consequently, this paper on the contribution 
of the measurement of performance to effective man- 
agement in local government, is one of a series of docu- 
ments devoted to an investigation of the application of 
specific modern management concepts and tools to 
municipal operations. This series, called ‘Series B Publi- 
cations: Technical Papers’, highlights areas of man- 
agement that require either greater attention or greater 
documentation, at least from a Canadian perspective. 
Other topics covered in this series are as follows. 


1 Strategic and Corporate Goal Setting in Local Gov- 
ernment. 


2 Organizational Change in Local Government. 


3 Systematic Approaches to Information in Local 
Government. 


Further details of LGMP publications are given in Ap- 
pendix 111 to this paper. 


These technical papers consist largely of summaries of 
developments and practices in the specific management 

topic area in Canada, the United States, and abroad. 

They include an attempt to put that information in 


perspective as a result of the LGMP experience. It is 
hoped that the information contained will be of use to 
municipal administrators, elected officials, and other 
interested individuals in developing a deeper insight 
into some important management processes in local 
government. 


The final publication of this paper was dependent upon 
the efforts of several individuals and the support of 
others. Jim Nininger, Gord McDiarmid, Ray DeBlasi 
and Charlie Ketcheson contributed many patient hours 
throughout, and Bonnie Brown from the Ministry of 
Treasury, Economics and Intergovernmental Affairs 
lent her support, helpful comments and insights over 
the long and tedious gestation period. Any questions or 
comments on the material covered in these papers will 
be welcomed and may be directed to the authors at the 
School of Business, Queen’s University, Kingston, On- 
tario. 


The authors would like to express their appreciation to 
the Province of Ontario, Ministry of Treasury, 
Economics and Intergovernmental Affairs, Advisory 
Services Branch and, in particular, Ted Gomme, for the 
support of this undertaking to help local government 
managers to improve the operation of their organiza- 
tions. 
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Executive Summary 


This paper reviews a number of ways in which perfor- 
mance can be measured in the local government setting. 
Performance measurement is regarded as an integral 
aspect of management, which inter-relates with other 
aspects of the management process and which contri- 
butes to productivity improvement. In fact, evidence of 
a clear understanding of management and the develop- 
ment of efficient processes of management can be re- 
garded as a measure of management effectiveness. As a 
first step in clarifying the relationship between meas- 
urement and other management processes, a manage- 
ment framework, which incorporates the role of meas- 
urement, is outlined in Part I. 


The approach taken in this paper is a reaction to what 
appears to be two major weaknesses of performance 
and productivity measurement in the past. These weak- 
nesses include: 


1 the rather general tendency to look upon perfor- 
mance measurement as a superimposed control pro- 
cess, rather than as a device which managers can use 
to increase their effectiveness; and 


2 a tendency to regard management as a ‘black box’ 
and to concentrate upon the measurement of inputs 
and outputs, with little regard or concern for the 
ways in which managers actually do their jobs. 


The first section of this paper establishes the context, 
through a discussion of what is meant by effective man- 

agement. In this section, a framework is established for 
use as a basis for the discussion and evaluation of the 

various approaches that have been taken to measuring 

performance in municipalities. One of the major con- 
tributions of this paper is that it directly relates perfor- 

mance measurement to effective management. Surpris- 
ingly, this relationship has been very tenuous in past 

discussions. 


The main body of the paper concentrates upon a review 
of measures and measurement systems. These include 
output, fiscal, program and management process 
oriented measures. The remainder of the paper relates 
these different approaches to the management frame- 
work. Examples of all the approaches are given, as are 
specific examples from the LGMP experience, in 
Appendix I. 


A major emphasis thoroughout this paper, is upon the 
acceptance by individual managers of responsibility for 
the efficient and effective management of their opera- 
tions. There is a need for managers at every level to 

define the purpose of their operations very clearly, to set 
definitive objectives and to develop procedures and 

processes whereby they can interrelate most effectively 


with other members of the organization. In other 
words, the processes of management are considered to 
be measurable and subject to improvement. This is in 
contrast to the stress usually put upon inputs and out- 
puts. 


Local government has been particularly weak in defin- 
ing clearly understood roles at the council level, while 
management processes and procedures have generally 
been hampered by the tradition of relatively indepen- 
dent departmental operation at the administrative 
management level. Again, the development of proce- 
dures which lead to effective processes in both of these 
areas is emphasized. 


The tendency to use measures as controls, particularly 
in financially oriented systems, is brought into question. 
It is suggested that management at each respective or- 
ganizational level must take responsibility for monitor- 
ing efficient and effective management at the level 
below. This can be most effectively accomplished 
through the identificatiion of clear goals and objectives 
at each level and the definition of procedures for in- 
teraction where necessary. Each manager needs to de- 
fine measures which will indicate how efficiently and 
effectively he is performing. Where managers are re- 
sponsible for programs, program purposes need to be 
defined and clear goals, objectives and performance 
indicators established at the outset. Unless a program 
has a clearly defined purpose and clearly defined goals 
and objectives, the effectiveness of that program is im- 
possible to determine — measures must be related to 
what the program is established to achieve. 


The same approach holds true at the council level. 
Councils too, need to clearly define roles and to dis- 
criminate between their political and management 
roles. Municipal corporate goals and objectives are 
necessarily political in nature because they should rep- 
resent the most appropriate resolution of conflicts in 
planning for the future. The implementation of those 
goals and objectives, on the other hand, is a manage- 
ment process, and council, as the top management level 
in a municipality, must ensure that rational manage- 
ment processes are established to fulfill that role. The 
development of incentives and reward systems, which 
are capable of discriminating between effective and less 
effective performance at the top administrative level, is 
a crucial aspect of council’s management role. To do 
this effectively, council needs advice from personnel 
experts. Unfortunately, this type of utilization of exper- 
tise is rare in local government. 


Itis recognized that there is a need for control processes 
- 


in addition to individual managerial acceptance of re- 
sponsibility. Once again, however, it is felt that the 
emphasis should be upon the way in which financial 
audits, management audits or performance appraisals 
can assist managers and help them to develop better 
management systems. At the same time, of course, these 
processes should help to identify and eradicate ineffec- 
tiveness and inefficiency in the system. The best control 
processes, however, encourage managers to improve 
their performance and give them some direction to do 
so rather than just penalizing those managers that step 
out of line. 


Essentially, this paper contributes two new practical 
dimensions to the use of performance measurement in 
local government. 
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It presents a broadened perspective of performance 
measurement that relates it directly to a framework 
of effective management. 


It suggests the incorporation of a systematic ap- 
proach which will allow managers at all levels of 
authority to evaluate and review the performance of 
their own activities, and which will enable them to 
determine what they personally can do to improve 
their own operations and the effectiveness of the 
organization. 


An Introduction to the Measurement of Performance in Local Government 


Performance measurement provides feedback to a 
manager, to a group or to an organization regarding the 
impact made by their efforts on the job. This feedback 
may take a number of forms but its primary purpose is 
to tell managers what is currently being accomplished 
on the job to enable them to improve subsequent per- 
formance. 


Interest in the measurement of performance in the pub- 
lic sector has been greatly stimulated over the last five 
years. Much of this interest and activity has been cen- 
tered on developing and experimenting with measures 
of efficiency and effectiveness in the delivery of local 
government services. Some major reasons for this surge 
of enthusiasm for measurement include double-digit 
inflation, the more prominent role of government in 
society combined with a growing distrust of large in- 
stitutions, including government, the problems of the 
growing energy crisis, the warning signal provided by 
New York’s financial dilemma, and some dramatic 
changes in work-related value systems. Caught between 
the growing demands for more and better services and 
the ever-rising costs of providing them, municipalities 
have sensed a need to improve their productivity. 


One of the effects of this squeeze has been a growing 
interest in the relationship between the impact of the 
government on the environment and the resources that 
are used to support that impact. Increased awareness of 
performance is a natural result of this interest. 


There are many serious limitations or constraints both 
upon performance and the ability to measure it in most 
local government organizations. Some of these may be 
necessary limitations, imposed by the nature of the task, 
the political process and the variability of the people 
being served. It is important, however, to distinguish 
between what actually happens as a result of local gov- 
ernment activity and what can happen, and to measure 
results or performance where possible. Otherwise an 
unnecessarily inefficient, ineffective and costly opera- 
tion may result. 


Performance measurement can provide information 
which will help managers in many ways. 


1 It can help administrators and elected representa- 
tives to gauge the impact of municipal programs and 
to generally assess the performance of the munici- 
pality in providing the services desired by the citi- 
zens. 


2 It can assist support department managers to deter- 
mine whether or not they and their staff have been 
successful in producing the service or product de- 


sired by those line departments which depend 
upon them. 


3 It can provide a comparison of performance with a 
standard, an ideal level, or among departments, sec- 
tions or even different municipalities, thus giving an 
indication of relative efficiency. 


4 It can provide the information needed to guide 
decision-makers in assessing the relative value of 
allocating resources to one service area as opposed 
to another, thus increasing the discretionary power 
of both elected and administrative officials. 


5 Performance measurement information can indicate 
what the cost of producing the product or service is 
per unit, and whether or not that cost is as low as 
reasonably possible. These measures can lead to cost 
reductions because they will stimulate more efficient 
methods of operation. Performance measurement 
pinpoints management areas which need to be im- 
proved and creates pressure for action. 


6 Itcan provide a measurement of the extent to which 
time or money is saved and/or the degree to which 
the quality or quantity of the product or service is 
improved as a result of some definitive management 
action. 


7 It can help to ensure that the services supplied are 
aligned with the policy objectives of the local gov- 
ernment; that is, to measure the effectiveness or 
success of the municipality, its departments and in- 
dividual managers in achieving stated objectives. 
Also, as data are collected over time, trends are 
revealed, and it is possible for individuals to deter- 
mine whether improvements in performance are 
being made and at what rate. 


8 Through impact studies, it can help to assess the 
appropriateness of the policy objectives themselves. 


9 It can help municipalities to develop fair reward 
systems based on actual levels of performance and 
thus to reward higher productivity and positive 
changes. 


10 The fact that performance can be measured provides 
an incentive for the improvement of performance 
and can, in itself, encourage efficient management. 


The potential benefits are numerous but performance 
measurement also has its problems, especially for non- 
profit monopolies in an undefined marketplace. The 

most basic and pervasive unresolved problem involves 
what to measure and how to measure it. Possibly it is for 
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this reason that performance is so seldom measured or 
effective management appropriately rewarded in 
Canadian municipalities. Unfortunately, no up-to-date, 
state-of-the-art survey is available but from the LGMP 
experience and research, it appears that Canadian at- 
tempts to measure the productivity of any aspect of 
local government activity are few and far between. In 
the actual utilization of measurement in local govern- 
ment management, however, Canada may not be too 
far behind the United States, in spite of a lag in research. 
American commentators in the early 1970’s noted that 
costs were rarely associated with output measures and 
several studies have illustrated the difficulties as- 
sociated with the development of standards which 
apply across different situations.! It is safe to conclude 
that little is known about the productivity of local gov- 
ernments. 


Some governmental organizations which have become 
involved with measurement have recognized the poten- 
tial benefits. They have found that some indication of 
performance is an essential prerequisite for success in 
most innovative administrative programs, whether 
those programs involve organizational development, 
strategic planning by council, administrative planning, 
or the use of operational models. Without indicators 
and information systems which provide feedback re- 
garding the adequacy of the services being provided, 
initiative soon disappears, and/or efforts may be mis- 
directed. 


Essentially, performance measurement is a fundamen- 
tal part of the management of an organization, provid- 
ing an understanding of where an organization stands, 
whether or not it is performing its role and how it can 
improve its operations over time. Approaches to the 
measurement of performance, therefore, must flow 
from the concept of management itself, providing the 
information and guidelines required to assist efficient 
and effective management. If the potential benefits of 
performance measurement, as outlined above, are to be 
realized, measurement must be regarded as a funda- 
mental aspect of management and there must be a spe- 
cial focus upon its contribution to managerial decisions, 
activities and processes. 


The authors of this paper firmly believe that any at- 
tempt to measure the performance of an organization 


1 36 (Footnote numbers refer to publication in bibliography, 
Appendix 1). 

2 See Performance Measurement Programs described in 
Appendix 1. 
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should include the clear indentification, understanding 
and measurement of the management activities in- 
volved in operating that organization. This statement 
suggests a different approach to performance meas- 
urement than has been taken to date, although some of 
the same tools and techniques are relevant. The purpose 
of this paper is to outline and discuss this new approach 
in the perspective of what has gone before. 


In short, what we hope to contribute through this 
paper, is a broad perspective on performance measure- 
ment which moves away from the narrow emphasis on 
either input or output and focuses as well on the meas- 
urement and improvement of management perfor- 
mance. This comprehensive approach should provide a 
context for management improvement, through the ex- 
amination and evaluation of existing management sys- 
tems. 


The following section will describe a framework or 
perspective for understanding how performance meas- 
urement can be seen as an integral part of the manage- 
ment of a municipal operation. The remainder of the 
paper will use this framework as a basis for the discus- 
sion. Parts 111, 'v, V and vi discuss the approaches 
which have been taken to incorporate measurement in 
management systems. This discussion emphasizes the 
different types of measures used in each approach and 
the purposes they have fulfilled. Further examples of 
measures and more information on current practices 
are given in Appendix I. 


Part vil evaluates the various approaches and an 
attempt is made to draw them together. It also includes 
recommendations for future attempts at performance 
measurement. The paper concludes with Appendix UU, 
an annotated bibliography of the literature found most 
useful as a basis for this discussion. 
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A Framework for Measuring Performance 


Managers need information which provides them with 
feedback in order to measure and evaluate their own 
performance. Armed with this knowledge they can 
adapt their operation to meet client needs more ade- 
quately and economically, whether that client is the 
public or a part of their own organization. Measure- 
ment and evaluation, therefore, are fundamental as- 
pects of an overall management process. This process 
should include the following: 


1 the development of a clear understanding of the pur- 
pose of the organization and of all its elements (the 
reasons why they exist); 


2 the identification of both the general goals and 
specific objective activities which an organization 
and its sub-organizations need to carry out to 
achieve their purposes; 


3 the development of structures and procedures which 
will result in appropriate patterns of interaction and 
processes of management to achieve the goals and 
objectives, and the obtaining of the necessary 
human, material and financial resources; 


4 an ongoing adaptive management operation involyv- 
ing monitoring, controlling and continuous feed- 


back; 


5 aperiodic, detailed, evaluative procedure for ensur- 
ing that the purpose of the organization is being 
fulfilled and its goals and objectives are being 
achieved; and 


6 both ongoing and periodic modification and re- 
establishment of goals and objectives. 


Effective management therefore involves a continuous 
and circular process of clarification of purpose, plan- 
ning of activities, implementation of those plans, 
monitoring of the production process and modification 
of that process and previous goals and objectives, in 
response to feedback. Measures of performance are 
needed throughout. In fact, one measure of effective 
management may be the very existence of each recog- 
nizable part of a management process such as the one 
described. Other measures may involve a determination 
of how well those processes are being carried out and 
what the costs are in terms of time and other resources. 


Output measures, related to objectives and to costs, are 
indicators of organizational effectiveness and efficiency 
which can identify areas for improvement. The effi- 

ciency of management processes (the things managers 
do) is also important and can also be measured. When 
output is measured in combination with the processes 


of operation, information which helps in adapting to 
changing requirements and in management improve- 
ment is more readily attainable. Without measures of 
the processes of operation, management essentially 
functions in a vacuum, yet the LGMP experience indi- 
cates that this type of analysis is probably the least 
developed area of municipal management. This appar- 
ent lack of interest in management processes is all the 
more startling in government agencies, because they do 
not have the valuable measurement criterion of profit 
and they, therefore, need all possible indicators of effec- 
tiveness. 


Too often, the circular process of management, as de- 
scribed, gives way to a short-term perspective, and 
managers bump along from crisis to crisis without 
learning from, or perhaps even identifying, their succes- 
ses and failures along the way. Since they are not clear 
exactly where their organization stands, what has hap- 
pened in the past, or what action was taken, the lack ofa 
performance measurement system, related to particular 
management activities, will tend to result in reactive 
rather than proactive management. 


It would seem that the most useful approach to perfor- 
mance measurement is to take a broad perspective in 
identifying the types of performance information that 
are needed for effective management at each position 
and management level. Although the requirements for 
an effective management system are the same at each 
level in the management hierarchy, the type of informa- 
tion needed to be fed back into the system will differ 
quite significantly, often differing for each manager. 


Very junior managers, close to the production process, 

usually have a relatively short time horizon. They tend 

to be technicians, dealing with practical applications. 
Feedback needs to be immediate. It tends to deal with 
tangibles and, as a consequence, measurement is rela- 

tively easy. Even at low management levels, however, 
the processes of interaction with subordinates are im- 
portant, particularly if the expert input of those subor- 
dinates is needed. Measures of such processes are dif- 

ficult but possible. 


Both middle and lower level managers develop tactics 
from strategic and corporate plans created at a higher 
level. At these higher levels the time horizon is 
lengthened. For instance, in the case of road repair, 
where the junior manager may be interested in deciding 
which holes in the road to fill, what mix to use and how 
well his people are performing, the middle manager 
decides which streets require repair and in what order 
over the next few weeks or months and what type of 
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manpower will be required over that period. The deci- 
sion processes and the processes of monitoring and 
control will be quite different at different levels. 


At the more senior levels the concern is with policy, 
planning and strategy. Decisions involve the defining 
and redefining of the organization’s purpose, its 
strengths, weaknesses and resources, and determining 
how it can best allocate its resources to maximize the 
organizational impact on the environment over time. 
Using the road repair example, decisions might involve 
whether the organization should be responsible for 
road repair and, if so, determining how holes in the 
street can be prevented or how the problem can be 
approached more efficiently and effectively, perhaps by 
contracting the job out. 


Obviously the type of information required at each level 
to determine how well the activities are being per- 
formed will differ significantly. The tactics of a job may 
be executed very efficiently, however, the measures that 
are well suited and developed to indicate this efficiency 
will probably not measure the appropriateness of the 
planning and strategy decisions upon which the tactics 
were built. If the strategy is wrong, measurement re- 
lated to execution will not indicate that error. Con- 
versely, the type of broad, long-term information 
needed to assess strategy will not be useful to the tactical 
manager who wants specific feedback on the way his 
crew is performing. 


Essentially, performance measurement information is 
of three main types, requiring quite different measure- 
ment systems. These types are: 


1 measures of the service delivered; 
2 measures of cost effectiveness; and 
3 measures of actual managerial behaviour. 


Strictly speaking, managerial behaviour contributes to 
the effectiveness of service delivery. The relationship is 
not always direct, however. It is not always easy to 
pinpoint the independent variable upon which service 
delivery effectiveness relies. Also, since the degree of 
influence upon service delivery effectiveness differs for 
managers at different levels, the distinction between 
service delivery and the managerial contribution to that 
delivery is real and important. Unfortunately, this dis- 
tinction seems to have been overlooked in the literature, 
and management takes on the aura of a ‘black box’. 
Measures of actual managerial performance appear to 
have been neglected in previous discussions of perfor- 
mance measurement and organizations are seldom re- 
ally aware of the actual activities or of the effectiveness 
of its managers. 


In summary, the rationale for performance measure- 
ment lies in its potential contribution to effective man- 
agement. The framework for effective management in- 
volves managers at all levels defining their purpose, 
establishing goals and objectives, getting the necessary 
activities under way and monitoring and evaluating 
progress. Managers at the upper level of the hierarchy 
plan, establish the corporate strategy and activate large 
portions of the organization, while those at the lower 
levels ensure the efficient execution of tactical opera- 
16 


tions. Managerial goals and objectives at each level 
contribute to those of the higher level. Measures of 
actual managerial performance or behaviour are essen- 
tial for management improvement under this system. 
The types of measures needed at each level will differ 
and will be determined by the scope of operation of each 
manager. In this framework, performance measure- 
ment, or management information feedback, is based 
on a determination of the type of information that will 
be needed by managers at different levels in order that 
they may monitor, control, evaluate and review the 
things that they do. 


Local government managers have developed a number 
of different strategies to provide them with this feed- 
back. Most early attempts at the process of perfor- 
mance measurement dealt with inputs into the organi- 
zation. These were usually related to the budget process 
which existed as a line-by-line budget dealing with ob- 
jects of expenditure. It was realized, however, that by 
themselves, inputs were not good indications of per- 
formance. Measures of output or activities were next 
recognized as being essential indicators of performance. 
Thus interest turned towards the development of 
strictly output or throughput productivity measures. 
These were tangible, highly visibleand therefore politi- 
cal, and they were also relatively easy to measure in 
quantitative terms. Examples would be tons of solid 
waste collected or miles of road paved. 


More recently, however,the growing interest in perfor- 
mance measurement has demanded that measures be- 
come more useful with respect to their ability to define 
areas of management weaknesses and strength and to 
identify potential areas of management improvement. 
More complex measures have emerged as the number 
and variety of requests for feedback on municipal per- 
formance have grown. 


Engineering managers are not the only ones interested 
in measuring their own performance, but other ‘soft’ 
service departments, support departments, budget 
committees and committees of council are also looking 
more carefully at both their management and the im- 
pact of their decisions. At the council level, the recent 
financial constraints have led to the awareness that 
there is a need for more effective means of evaluating 
the performance of administrators and of developing 
reward systems for effective management. 


The growing demands of an increasing number of citi- 
zen groups have also prompted a recent enlarging of the 
performance measurement concept to include such 
areas as recreation, health services, pollution control, 
traffic flow patterns, spending priorities, community 
services, etc. 


In an attempt to meet these demands, finance depart- 
ments are requiring and developing more refined sys- 
tems to track financial performance. Financial audits 
are no longer sufficient to satisfy municipal needs and as 
a consequence new financial methods such as zero 

based budgeting, covered elsewhere in this paper, are 
being tested for their appropriateness in meeting munic- 
ipal needs. Management auditing is anew phrase which 
is becoming more common and some financial audits, 


such as the Auditor General of Canada’s reports have 
considerable implications for management.! 


As the need for better methods of evaluation grew, so 
the approaches become more sophisticated. The basic 
problems facing any attempt to measure performance 
remain the same, however. These are: 
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what to measure — what inputs and outputs are 
directly related to effectiveness and efficiency and 
will provide the most valuable information; 


how these measures can be obtained — what instru- 
ments can be used to ensure that the information 
obtained will be valid and reliable; and 


how this information can be most appropriately used 
by managers to improve their performance. 


The next four parts of this paper investigate some of 
the systematic ways in which administrators have ap- 
proached the problem of performance measurement. 
The discussion will examine the types of measuring 
systems that have been devised to monitor, control, 
evaluate and review the accomplishments of both man- 
agers and municipal organizations. The different types 
of measuring systems can be defined as follows: 


output oriented approaches, measuring the impact 
of the municipal ‘products’ on the environment; 


fiscally oriented approaches, more broadly based 
attempts to measure strategies and programs on a 
cost and benefit basis; 


program oriented approaches, measuring the effects 
and value of the various municipal programs as a 
whole; and 


management process oriented approaches, attempt- 
ing to measure the performance of managers or or- 
ganizations directly rather than indirectly through 
the output of the organizational units. 


Each of these approaches will be discussed and analyzed 
in turn. 
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The Auditor General’s Financial Management and Control Study 
of 1975 was essentially a management process audit. 
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Output Oriented Approaches 


Output oriented approaches are so called because they 
are related to the delivery of the final product or service. 
They attempt to measure the quantity of output, the 
direct impact of the product on the environment, the 
level of delivery, the cost of that level, etc. Output 
measures can be broken down into three classes: 


1 throughput measures, 
2 efficiency measures, and 


3 effectiveness measures. 


This ranking is in order of complexity and value to the 
different organizational levels. It is also the order in 
which they can most readily be introduced to local 
government services, in terms of existing data, the time 
required to develop valid and reliable indicators, and 
the costs involved. These various output measures will 
be defined in greater detail beginning with the most 
basic. 


1 THROUGHPUT MEASURES 


These are product oriented measures which focus on the 
output or result of an activity without any particular 
regard for the cost, value or worth of that output. 
Throughput measures include such quantities as gallons 
of water processed, number of households served, 
number of patients treated, welfare cases processed or 
crimes solved, etc. These are the most popular perfor- 
mance measures. They are also the simplest measures, 
tending to concentrate on the tangible results — those 
things which are amenable to simple measurement by 
number. 


The usefulness of throughput measures tends to be very 
limited because the information contained is minimal. 
Output numbers which are not systematically related to 
the purpose for the output or to the processes involved, 
give no indication of how effectively the work was 
done. When no attempt is made to incorporate input 
measures, efficiency is not determined. If processes are 
ignored, actual management effectiveness cannot be 
estimated. For all their limitations, however, through- 
put measures do represent a foundation for thinking 
about performance measurement in terms of results 
rather than the more traditional inputs or costs. 
Throughput measures may be useful if they can be easily 
compared with past performance or with similar units 
elsewhere. In this way they can be used to justify expen- 
ditures or to determine budget requirements. 


2 EFFICIENCY MEASURES 


Efficiency measures are also product oriented. They 
differ from throughput measures in that some indica- 


tion is given of the resources necessary to produce that 
output. Cost factors can be stated in terms of dollars or 
man hours. Efficiency measures focus on how economi- 
cally the resources (inputs) are converted into services 
or results (outputs). Consequently, they are more useful 
and have more appeal than throughput measures. The 
costs involved are often not difficult to obtain because 
traditionally costs have always been collected for 
budgeting purposes. 


Examples of efficiency measures for garbage collection 
are as follows. 


Tons collected per crew collection hour. 
Households serviced per crew collection hour. 
Costs per ton collected. 

Costs per stop. 


Number of people served per truck per week. 


The table presented on the following page is an example 
of such measures. 


Efficiency measures may be stated in different ways: 
a as a measurement of unit cost; 
b related to a work standard, and 


c as a measure of utilization of resources. 


a Unit cost measurement 


These are measures of workload performance that are 
expressed in dollars, e.g. cost of 10,000 gallons of sew- 
age treated, cost per yard of street paved. The reciprocal 
of these is the measure of productivity, e.g. yards paved 

per dollar cost. 


An extension of unit cost measurement is cost-effect- 
iveness analysis. Some kind of cost-effectiveness 
analysis is involved in any resource use decision, such as 
the construction of a road or a bridge or a school. The 
physical characteristics are specified and an attempt is 
made to find the least expensive way to satisfy these 
specifications. Often the specifications have to be ad- 
justed to fit into the budget and the question becomes, 
‘What is the best bridge (or road or school) that can be 
built for the money allotted?’ Usually some of the 
specifications can be traded for others at a given budget 
level. Higher speed of construction may mean less 
durability; greater elegance of design may sacrifice cer- 
tain safety features. It is important to know what is 
being traded and at what cost. 


Cost-effectiveness analysis is merely an extension of 
these basic ideas into other, sometimes more complex, 
public decision problems. It is an attempt to specify 
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PRODUCTIVITY PERFORMANCE IN A RESIDENTIAL SOLID WASTE COLLECTION SYSTEM?! 


Level of 


Crew 
Service Size Productivity Performance Measure 
Households No. People 
Tons Collected/ Serviced/ Served/ 

$/Ton $/Stop Crew Collection | Crew Collection = Truck/ 

Collected Hour Hour Week 
Gods iad 1 ot 8.44 ye, Dod 100.9 7763 
or Alley 
Once- 2 men 11.82 9: Zu 109.6 POLy 
ah 3 men 10.34 38 3.8 99.2 7060 
Curb : 1 man aya! 38 be 88.5 3636 
or Alley : = iad paaeee 
Twice- 3 men 13.65 4S 3.0 199-5 6316 
a-week 
Backyard 
Once- 2 men 18.00 fol ee rake 5130 
a-week 


what is to be done in order to examine systematically 
the alternative ways of doing it. Cost effectiveness 
analysis is useful in answering questions about how to 
achieve a specified set of objectives at the least cost, or 
how to get the most effect from a given set of resources. 
It can be used to help answer the following types of 
questions. Can alternative activities be designed to 
achieve the same results at lower cost? Might some 
changes be made in the procedure to make it operate 
more efficiently without additional expense? 


b Work standards 


The concept of work standards involves the establish- 
ment of a set of quantities that should be achieved on 
the job. Standards are determined by establishing the 
best procedure for the operation and the resources 
necessary to carry out that activity. The time for the job 
is observed and measured under good conditions. 
Thereafter, whenever a manager undertakes a job of 
that type he will record the time, equipment, materials, 
etc. that were used and relate these to the standards set 
for the job. 


Setting standards is not always a simple procedure. 
Certain problems may have to be overcome during the 
process, depending upon the measurement intended. 
These include: 


i realistic and yet somewhat demanding standards 
must be determined if they are to be used for perfor- 
mance measurement; 


11 methods, equipment, facilities and qualifications 
must be specified or standards are relatively mean- 
ingless; 


os 


iti the real needs of the client (either the public or other 
managers) must be determined and defined before 


effective objectives can be determined; 


1 74, p. 8. 
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iv records must be kept of both output and costs for 
most measures; 


v details of projects or tasks to be completed must be 
completely specified and any discrepancies noted 
after completion; 


vi levels of service must be identified and accurately 
measured; and 


vii accurate measures of quality must be available and 
the quality must be controlled. 


In spite of the above requirements, standard setting is 
feasible in many areas of production and service deliv- 
ery and, in some cases, is almost mandatory for an 
effective operation. 


Work standards can be used in areas where job proces- 
ses, procedures and outputs are routine, where jobs are 
repeated frequently and where the quality of the output 
does not differ significantly. Many routine clerical tasks 
are amenable to the application of work standards as 
measures of productivity. Work standards can also be 
applied to many of the activities of public works de- 
partments, parks and recreation departments, etc. In 
this area the Ministry of Transportation and Com- 
munications of Ontario has implemented a Municipal 
Maintenance Management System in Ontario 
municipalities. The M.M.M.S. is a performance oriented 
management system that encompasses program de- 
velopment, budget preparation and evaluation, and 
work and fiscal expenditure control for road related 
services. Activities are broken down into definable and 
measurable units so that men and material require- 
ments can be calculated. When a service level is chosen, 
accurate costs can be computed and allocated accord- 
ingly. Thereafter, any contemplated increase in the level 


of service offered can have an incremental cost as- 
sociated with it. 


A simplified example would be machine sweeping of 


downtown roads and residential streets. Council, or a 
committee of council, may have set a standard that 
curbs and gutters shall be cleaned every three weeks 
between April 1 and November 30th. This operation 
could be broken down into the following categories for 
one day’s sweeping. 


Manpower (one operator at 


$6.00 per hour for 8 hours) = $ 48.00 
Machinery (one sweeper at 
$12.00 per hour for 8 hours) = $ 96.00 


Materials (800 gallons of water per 
day at 36c per 1000 gallons) =p 2S 


Supervision (supervisors may charge 
their time to this account or a more 
general account, e.g. $8.00 per hour 


for 2 hours) = $ 16.00 
Total cost of sweeping per day = $160.28 
Number of miles swept = 20 
Unit cost per mile of street swept = $ 8.01 


These figures are usually aggregated over a period of 
two weeks or one month and compared against the 
budgeted values. The information sheets at that time 
give actual unit cost and standard unit cost. The break- 
down of the figures can vary, for example, where labour 
is used intensively it may be useful to break down the 
labour cost per mile, etc. 


The Government’s objective for the MMMS was to have 
all or a high percentage of Ontario municipalities in- 
volved, so that comparisons could be made between 

them under similar circumstances. Where differences 
existed, these could be defined. 


One of the problems with this particular efficiency 
measurement system is that it is very time consuming 
and requires a good deal of continuous paper work. 
Small municipalities may find this a particular hard- 
ship. It also may constrain the initiative to improve 
performance, since a standard can easily become an 
upper limit. Allocation of costs to different programs is 
also difficult and financial control problems frequently 
ensue. 


The benefits that accrue are that budgeting is sup- 
posedly facilitated and staff and workload levels can be 
determined and allocated.? Standards establish expec- 
tations of what is to be achieved during the workday 
and, therefore, they help in organizing the people and 
equipment. 


Municipalities also use standards in other ways. Stan- 
dards that affect output, but which are not directly 
related to work performance, include specifications in 
such areas as the determination of the eligibility of 
welfare recipients or the adequacy of low cost housing. 
Most departments could use standards, at least to some 
extent, but motivational problems may accompany 
their use since they involve almost a mechanical ap- 
proach to human resource management. 


c Utilization of resources 


It may also be possible to measure the efficient use of 
resources by distinguishing between productive work 
time (when employee or machine time is spent on work 


tasks that contribute directly to the desired outputs), 
and non-productive work time (when time is spent on 
work tasks which are either unnecessary or marginally 
useful in achieving the desired outputs), or idle time 
(when employees or machines are not engaged in as- 
signed work tasks).° Increased efficiency or productiv- 
ity is obviously related to reducing the non-productive 
or idle time of the resources, e.g. when buses have empty 
seats, when libraries are poorly used, when equipment 
is in the repair shops or when skilled personne: are 
standing around. Information is needed to determine 
what output level might be accomplished and what level 
is presently being achieved. Standards can be useful in 
analyzing the difference between actual and ideal per- 
formance when trying to determine and reduce the bar- 
riers that prevent the more productive level being 
reached. 


The table overleaf is an example of the use of standards 
in combination with utilization measures. 


Measures of efficiency can be helpful in making choices 
between municipally and privately operated services, 
and between new equipment and older equipment with 
higher manpower demands. As with throughput meas- 
ures, efficiency measures are more useful over time and 
when they can be compared with other operations. This 
aspect, however, has been criticized because of the dan- 
gers involved in assuming that measures are similar 
when, in fact, aspects such as the environment and 
accounting methods may differ. 


One of the main criticisms levelled at throughput and 

efficiency measures is that they largely ignore the qual- 
ity aspect of the impact of the product on the environ- 
ment. Anexample of this is the following. An education 
process can be very efficient in terms of output of stu- 
dents through the system who receive diplomas. This 
output criterion, however, does not measure education 
in terms of learning and improved ability to understand 
and prosper because of the education experience. An 
operation can be very efficient but this does not neces- 

sarily mean that the service it provides is of high quality. 


Another example of this problem is the following. 


A government can almost overnight significantly in- 
crease its efficiency in terms of ‘the number of tons of 
garbage collected per man-hour’ by shifting from 
backdoor to curbside collection. Of course in doing 
so, the level of service to the citizen has been de- 
creased. The burden of moving the garbage from the 
backdoor to the curb has merely been shifted from 
the government employee to the citizen. Thus, it 
seems overly generous to label such increases in ‘tons 
per man-year’ as an increase in government produc- 
tivity. Such examples abound in government 
services.° 


2 Where a work force carries out one or two reasonably routine 
activities, financial control is facilitated by such a system, as 
accounting for personnel resources is reasonably straightfor- 
ward. Where a number of parallel, diverse activities are being 
carried out by a work force the control problem is considerably 
more complex. 


Seo pa 
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MONTHLY MANPOWER UTILIZATION REPORT, CITY POLICE RECORDS SECTION* 


Number Standard Actual Manpower 

Standard Unit Units Per Measured Standard Utiliza- 
Description Measure Completed Unit Hours Hours tion (%) 
1. Type and file each card 9,613 OS 520 480.7 93 
master index cards filed 
2. Type and file each report 3,261 oe 1,247 1,043.5 84 
crime reports filed 
3. Conduct name/ each re- 10,431 .08 bn 834.5 94 
location search quest 

received 
4. Process arrest each record 1,042 ve 853 802.3 94 
records filed 
5. Update tele- each entry 5,403 .03 153 162.1 106 
type information completed 
6. Maintain each war- 251: 23 105 Tae 97 
Warrent files rant 

received 
7. Miscellaneous each day 30 LO? 407 306 aS 

completed 

TOTAL 4,166 Sheva Olle 89 


Consequently, although a service may be more efficient 
the quality or the level of service may suffer.* In some 
cases the ‘real’ efficiency of the operation may actually 
decrease. Shifting the garbage pick up to the curbside, 
for example, may not always be less expensive. In one 
study it was found that, 

. insome cases, higher levels of service actually cost 
less than a lower level service. For example, one city 
picks up the trash three times a week from the back- 
yard for $2.66 per month for each household. A 
county in the same metropolitan area picks up only 
once a week, and from the front curb — so that 
residents have to carry the containers to the curb 
themselves — at a cost of $3.60 per month for each 
household, or 35 percent more costly than its neigh- 
bouring jurisdiction’s higher level of service.” 


Consequently, quality can be reduced without an as- 
sociated decrease in costs. The ideal, of course, is to 
increase efficiency so that the level of service is im- 
proved without additional resources. In order to ac- 
complish this, measures are needed of the quality of the 
product or service being offered. These are commonly 
called effectiveness measures. 


3 EFFECTIVENESS MEASURES 


Throughput and efficiency measures determine the 
quantity of output and may relate that quantity to the 
cost of production. Such measures tend to be task re- 
lated. Effectiveness measures are still output oriented 
but they measure the quality of the impact and not just 
the quantity. Specifically, effectiveness measures are 


6 Standards may also be used to measure quality of output. Of 
course, internal quality control is not a direct measure of impact. 
1 Mae ee 
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more results oriented. They focus on how well a task is 
accomplished without particular regard for the cost of 
the output. More than the previous measures, effective- 
ness measures attempt to determine the worth and value 
of the output. They indicate whether municipal ac- 
tivities are meeting citizens needs or are in the best 
public interest. They do this by measuring the effect of 
the activity rather than the activity itself. 


This adds a new dimension to measurement because 
efficiency measures give no indication of the impact of 
the output as it relates to the basic purpose of the 
activity. Measuring tons of snow removed, or compar- 
ing and analyzing the cost of picking up that snow will 
not determine whether or not the streets are clear. Simi- 
larly, analysis of the cost of garbage collection or of 
road mending will not determine if the streets are clean 
or the roads are free of bumps. 


Effectiveness measures set out to measure the extent to 
which the purpose of an activity is being achieved. 
Consequently, measures of this type may indicate how 
successfully a municipality is pursuing its goals and 
objectives. While effectiveness measures are more com- 
plex and subjective than throughput or efficiency meas- 
ures they are of far more value to the planners and 
strategists who make the decisions regarding the direc- 
tion of municipal efforts, e.g. in deciding which roads to 
mend rather than in measuring the productivity of the 
mending process. 


Although they may be qualitatively oriented, most at- 
tempts at effectiveness measurement try to express the 
measure in quantitative terms where possible. In these 
cases, the measure may be expressed as a percentage, 
perhaps of an ‘ideal’ situation, e.g. percent of crimes 
solved or illnesses successfully treated, or as a propor- 


tion, e.g. robberies per 10,000 homes. They can also be 
expressed in more general quantitative ways, e.g. re- 

sponse time to fires, transit time from location to loca- 

tion or the frequency with which streets are cleaned. 

Users have found that a heavy emphasis on quantifica- 

tion tends to restrict the latitude of effectiveness meas- 

ures. 


There are basically three approaches to measuring ser- 
vice effectiveness: 


a expert judgement; 
b client or user response; and 


c goal and objective achievement. 


a Expert judgement 


This approach involves training a civic employee to 
evaluate a service delivered by a department in which he 
is not employed. For example, specially trained inspec- 
tors might spend a portion of their time surveying and 
evaluating the cleanliness of streets, on a scale from very 
clean to very littered, in each neighbourhood of the 
municipality. Another portion of his time might be 
spent measuring the quality of road surfaces using a 
‘bumpiness’ index. In any such evaluation it is necessary 
that those who will be affected by actions taken as a 
result of the judgement see the evaluations as being 
fairly applied by all inspectors, reflective of the needs of 
the clients and indicative of the service being supplied. 


Another portion of an inspector’s time might be spent 
evaluating traffic congestion, as judged by the duration 
of time and severity of delay in travelling between dif- 
ferent points in the municipality along major routes. 
Information of this kind could very well result in 
changes in policy and resource allocation for various 
departments. 


b Client or user response 


Managers can obtain feedback from citizens, or from 
other managers in the case of a support service, about 
the quality of the service they provide. Each of these 
categories will be discussed separately. 


CITIZEN RESPONSE 


Citizen feedback is possible through information 
centres or through citizen surveys. 


Information Centres 


Citizen input can be obtained by setting up a complaint 
or information centre where citizens may phone in and 
comment on any facet of municipal service that they feel 
deserves attention. Consistent or frequent complaints 
can be investigated and evaluated as a basis for remedial 
action. This is a direct and inexpensive way of obtaining 
feedback from those who are most affected by the ser- 
vices supplied. 


Citizen Surveys 


Citizen surveys are considered to be the most popular 
vehicle for measuring the effectiveness of municipal 
activities. Proponents argue that they can bea valuable 
and accurate substitute in service areas that are not 
amenable to more quantitative measures. In fact, mar- 


ket researchers point out that governments are the fas- 
test growing users of their services. 


The following is an example of indicators of citizen 
evaluation that were used in a survey to evaluate a 
police force. 


i How fast respondents thought police serving their 
neighbourhood responded to calls for service. 


iu Whether respondents thought crime in the neigh- 
bourhood was rising, about the same, or decreasing. 


ui Whether respondents thought that police- 
community relations were outstanding, good, ade- 
quate, inadequate, or very poor. 


iv Whether respondents thought that the job per- 
formed by police serving their neighbourhood was 
outstanding, good, adequate, or very poor. 


v Whether respondents thought that police services 
were equally available to all in their community. 


Citizen input (in whatever form) is valuable as it can 
provide data for council and administration on such 
aspects of management as: 


i the degree to which objectives are being met; 


ii citizen awareness of and satisfaction with the qual- 
ity of municipal services or programs; 


iii the extent to which municipal facilities and services 
are used and by whom (in demographic, psychog- 
raphic and socio-economic groups); 


iv the reasons why specific services are liked, disliked 
or not used; 


v_ the possible adverse effects or influences of munici- 
pal facilities or services on certain sections of the 
community; 


vi the demand for new or increased services; and 


vii Community attitudes toward major decisions which 
have been made or which might be made. 


There are certain pros and cons of accepting systematic 
citizen input into political decision-making. 


Pros 


i Systematic surveys give a more representative view 
of citizen feelings than do meetings with minority 
pressure groups. Citizens are coming to realize that 
while small vocal groups can have considerable 
political impact there is no certainty that the group 
represents a sizeable majority of the population. 
Surveys have the advantage of using random sampl- 
ing methods to try and obtain the most accurate 
indication of the feelings of the majority. 


ii For many measures it is the only practical choice. 

iii Involving citizens in decision-making can lead to 
meaningful dialogue and citizens can also feel that 
they are participating in the community. 

Cons 


Some of the problems associated with systematic citizen 
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input and effectiveness measures in general are as fol- 
lows. 


i Properly conducted surveys with trained observers 
and proper sample sizes are expensive. To be most 
useful, surveys need to be designed so that they can 
be repeated at standard intervals. This process can 
be very costly for a smaller municipality. 


ii If the survey is not properly supervised and de- 
signed, validity and reliability can be a problem 
when trying to get accurate answers. Also certain 
groups of people may be more interested and articu- 
late. This could bias the results. 


iii Citizens may not be sufficiently well informed to 
give an overall judgement; for instance, individuals 
may not be aware of the operating costs of providing 
the service, of the alternative services that could be 
made available to them, or of possible improve- 
ments in the present service, and they may have little 
idea of how the level of service they are receiving 
compares with the service in other municipalities. 
Managers cannot rely on citizen surveys for answers 
or for direction for these reasons. With their know- 
ledge of choices and resources, and with their long- 
term perspectives, municipal managers are in a bet- 
ter position to judge long-term pay-offs from par- 
ticular decisions. Control must, of course, remain 
with council or else municipal organizations could 
be operating to meet the needs of administrators 
rather than those of the public. 


Although citizen input is expensive, recent increases in 
citizen awareness, focusing on municipal government 
services, indicate that more municipalities will find sub- 
jective indicators to be useful in the future. 


RESPONSES TO SUPPORT SERVICES 


Reactions of managers to support services are far easier 
to obtain than responses of citizens. Such measures can 
come in the form of joint review and planning meetings, 
in the form of regular surveys, or in the form of com- 
plaints and suggestions. Joint goal and objective setting 
can facilitate the measurement of support service effec- 
tiveness and corporate planning sessions can help in 
defining targets in this area. 


The measurement of support services will be discussed 
under the next section on goals and objectives, and 
again under the section on management processes later 
in this paper. 


c¢ Goal and objective achievement 


If municipal effectiveness means the extent to which the 
municipal organization fulfills its purpose, then the set- 

ting and achievement of objectives is a crucial form of 
measurement. 


The first step in goal and objective determination is to 
clearly determine the purpose of any service, ‘What is to 
be accomplished?’ Then the ongoing and specific ac- 
tivities which are to be undertaken to fulfill the purpose 
or aim are established and suitable measures are iden- 
tified. Performance in production or in the delivery of a 
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service can, of course, be measured without setting 
objectives. Objectives, however, add a dimension of 
planning and control to the improvement of perfor- 
mance; without carefully determined goals and objec- 
tives effectiveness is hard to estimate. 


To an extent, when a manager sets an objective, the 

achievement of that objective within a stated time and 
with a defined need for financial, human or material 
resources, is a measurement of performance. If the ob- 

jectives are determined carefully enough, performance 
can be measured in most areas of municipal activity. 
Objectives may be of various kinds; 


i objectives to complete a task, e.g. to provide a certain 
service, by a particular date; 


ii objectives to provide a particular level of service or 
quality or quantity of product; 


iii objectives to produce the same product or service ata 
lower cost; 


iv objectives to meet or improve upon a particular 
standard of production or service within a certain 
time frame; 


v objectives to produce a service or product which is 
more satisfactory to the person or people receiving 
the service; 


vi objectives to increase the output of individuals in- 
volved in production; and 


vii objectives to provide a satisfactory level of service at 
a lower cost. 


These objectives all involve the actual product or service 
directly, and the degree of achievement of such objec- 
tives gives a good indication of the efficiency and/or 

effectiveness of the managers and employees directly 

concerned with providing the service. Setting objectives 
for output activities is not without its difficulties, how- 
ever; it has not been successfully accomplished by many 
municipalities. Some of the problems that have been 

identified are as follows. 


i The absence of clear statements of measurable objec- 
tives. 


ii Objectives which are too broadly stated. 
ii Unrealistic or unachieveable objectives. 
iv Partial or inaccurate statements of objectives. 


v Objectives which are too detailed and which cover 


routine activities — thus consuming unnecessary 
time.9 


Foremost among institutions that have contributed to 
the development of performance effectiveness measures 
for local government is the Urban Institute of Washing- 
ton, D.C. During its short history the Urban Institute has 
produced an extensive body of literature covering all 
aspects of performance measurement although its main 
thrust has been the development of measures of the 
effectiveness of services as opposed to efficiency. 


The Institute staff have developed some extremely use- 
ful measures of effectiveness as well as subjective evalu- 
ation measures and social indicators. The Institute has 
been particularly active in developing techniques to 

measure the effectiveness of the delivery of such services 


as solid waste collection, recreation, local transporta- 
tion, and crime and fire control. This has been accomp- 
lished primarily by compiling the reports of literally 
hundreds of North American cities on their respective 
attempts at a wide variety of productivity improvement 
projects. 


The International City Management Association 
(ICMA), also of Washington, D.c., has recently increased 
its efforts in the performance measurement field be- 
cause of greatly increased requests for information and 
assistance regarding this subject from city managers. 
The 1cMA has worked closely with the Urban Institute in 
the research and development of performance indi- 
cators for local governments. These two organizations 
have co-sponsored several projects including a major 
project in Nashville-Davidson, Tennessee and St. 
Petersburg, Florida. 


This last mentioned project is particularly noteworthy, 
since its goal involved the development and testing of 
practical procedures whereby local governments can 
better measure the effectiveness and productivity of a 
number of the major government services. The em- 
phasis was on developing measures of citizen responses 
to services rather than workload measurements. An 
attempt was made to obtain citizen reactions to many 
city services such as fire protection, solid waste collec- 
tion and disposal, water supply, parks and recreation, 
library and transportation functions. Measures were 
established, as a result of those surveys, which seemed 
to supply relevant information regarding the effective- 
ness of the services.!° 


SUMMARY 


As can be seen, there are many approaches to measuring 
municipal product or service output. These should not 
be seen as being mutually exclusive but should be re- 
garded as being complementary, all joining together to 
produce a performance picture. It seems clear that taken 
alone, throughput measures are not very meaningful. 
Efficiency and effectiveness measures are necessary for 
a realistic program or performance evaluation, but they 
are also more costly and time consuming. Managers 
attempting to measure results should look reflectively at 
the measurement activity itself in order to choose the 
output measurement process which is most meaningful 
for management improvement. 


This suggests that performance measurement must 
begin by determining the type of management informa- 
tion needed at any particular management level before 
the choice of methodology is made. The methodology 
chosen will reflect what the output measurement pro- 
cess is to achieve. Effective management is the first 
consideration and the measurement system is designed 
as an integral supporting part of the management sys- 
tem. 


From the earlier discussion of the factors contributing 
to effective management this means determining the 

purpose of the activity, determining activity reference 
levels or standards of service quality, determining the 
adequacy of the services provided, setting objectives 

with performance expectations and targets for activity 
levels, organizing the resources, undertaking the activ- 


ity, monitoring the progress and adjusting where ap- 
propriate. It is apparent that all of the output oriented 
measures can be of use in this process, each adding a 
different dimension, each being more or less useful at a 
different stage in the management process or in the 
organizational hierarchy. 


It is not difficult to see, however, that output measures 
alone do not provide all the information needed at all 
levels. If the purpose is to measure management effec- 
tiveness rather than environmental impacts and costs, 
then output measures are not the best tools. It is true 
that results count and this has been the spur for output 
measurement rather than concentrating on purely in- 
ternal measures. However, by themselves, output 
measures are inadequate to fill the management need 
for reliable performance information. Some of the 
reasons are as follows. 


1 The measuring device may become an end in itself. 


This is a problem, particularly when the measure does 
not reflect the basic purpose of the activity. Once a 
measurement system is established it becomes the cue to 
guide productive behaviour during the accomplishment 
of that task. This is certainly the case if the reward 
system is tied to the measure. Consequently, it is very 
important that measures reflect the purpose of the be- 
haviour being measured. There are many instances 
where this is not the case — where improving behaviour 
related to the measurement does not improve the ser- 
vice. The example given earlier of the increase in effi- 
ciency of the garbage crew, which occurred as a result of 
a decrease in effectiveness, is one such example. The 
efficiency of the garbage crew must be described in 
terms that reflect the reason for its existence. This is a 
very simple concept but it is often overlooked in the 
establishment of the measurement or evaluative aspect 
of a management system. 


A more blatant example of this type of measurement 
problem is the case in which police output was meas- 
ured by the miles driven by the officer. As a consequence 
of this measure policemen spent their shifts driving 
from one end of town to the other. 


Using output measures or control devices may be dys- 
functional if they are relatively simple to fake. Most 
measures can be faked anda prime instance is the case in 
which garbage crews added water to their loads when 
they knew they were being assessed on the tons of 
garbage collected. The use of measurement as a control 
device may actually serve to eliminate its managerial 
usefulness. 


2 It is sometimes difficult to relate specific inputs to 
outputs. 


On all but the simplest jobs it is not a straightforward 
process to assign particular resources to a specific out- 
put. Some authors argue that the answer to this problem 
is to use multifactor productivity ratios whereby the 
relative contributions of labour and capital are deter- 
mined and assigned to one task. In some cases this can 


10 Publications from these and other institutions are included in the 
bibliography, Appendix 11. 
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be complicated, for instance, where both policemen and 
detection equipment contribute to criminal apprehen- 
sion. There is a problem involved in determining the 
relative effectiveness of each.!! 


3 Itis often difficult to assign specific responsibility for 
each activity. 


Output can be directly assigned to a specific manager 
only at the lowest levels of the hierarchy. Many prog- 
rams involve co-ordination and input from different 
sections or departments. Very few managers act entirely 
alone but rely on other operating units and support 
services to supply necessary resources and information. 
The way in which the various parts of an organization 
are integrated will often determine the overall effective- 
ness of an operation and will influence output. In such 
cases, the measurement of output in isolation from 
management processes provides little useful informa- 
tion. 


Uncontrollable factors, such as the weather, can influ- 
ence work load performance and this can create prob- 
lems. Output measures attempt to identify and measure 
the controllable aspects of a task or service. In many 
cases, however, more than one manager will have au- 
thority over the controllable aspects. In these cases, 
responsibility for the outcome cannot be directly ap- 
plied. 


4 Output measures are more suitable for tactical deci- 
sions than for strategic planning decisions. 


Managers at higher levels of the organization need dif- 
ferent types of information than those at lower levels. 
Measuring the efficiency and effectiveness of an activity 
may not be the type of information that will indicate 
whether or not that activity should be undertaken in the 
first place. A day care centre, for instance, may be 
operated most efficiently by the staff, measured in terms 
of inputs and outputs. The clients may be delighted with 
the service where previously no such facility existed. 
Efficiency and output measures, however, even though 
they are carefully made, will not tell the council whether 
or not the municipality should be in the business of 
providing day care centres, or to what extent, relative to 
other social service programs. Also, these measures will 
not help to assess whether the concept of a day care 
centre is the best approach to solving the particular 
community problem. Consequently, day care output 
measures are more useful and meaningful to day care 
centre managers than to commissioners of community 
services or to councillors. This example is typical of 
many municipal decision-making situations and indi- 


cates how the type of information needed varies at 
different organizational levels. By thinking purely in 
terms of output information, managers can lose touch 
with the meaning of the services they supply. 


5 Output measures do not measure the performance of 
managers at different management levels. 


The responsibility for output tasks becomes diffused 
throughout the hierarchy. The city engineer is, of 
course, ultimately responsible to council for shoddy 
vehicle or building maintenance or for a badly laid 
sewer. Output measures will not, however, identify the 
managerial level at which corrective action is necessary. 
In addition, output measures (or results) do not identify 
the poor manager, whose inefficiencies and ineptitudes 
are covered up by his subordinates or by input from 
other managers. There is no question that whole levels 
of unnecessary management exist in many municipal 
departments but output measures will not illuminate 
such problems. 


It is well worth repeating that output measures will not 
measure strategies, assess lost opportunities, or in gen- 
eral identify and evaluate performance levels at the 
higher end of the hierarchy. For instance, they will not 
determine how effectively and efficiently the senior 
management team is operating or whether a municipal- 
ity is making the right decisions at the corporate level. A 
poorly motivated and managed senior management 
team can, however, have drastic implications for both 
the efficiency and effectiveness of a municipal organiza- 
tion. 


It has been the experience of this Project and a crucial 
point in this report that the major problems in measur- 
ing performance and in attaining effectiveness and effi- 
ciency, arise in management areas which are less di- 
rectly related to production and service delivery. Cer- 
tainly, this is where a great deal of inefficiency and 
ineffectiveness exists. Local governments may have this 
problem to a lesser extent than other levels of govern- 
ment, but the consequences are still major ones. It is true 
that performance is difficult to measure in upper level 
management, in the interface between administration 
and council, and in the design and delivery of internal 
support services. However, both measurement and 
management improvement are certainly possible in 
these areas. Unfortunately, the setting of clear objec- 
tives and the measurement of efficiency and effective- 
ness in higher levels of management have not been 
particularly successful to date. 


Fiscally Oriented Approaches 


Probably the best way to begin a discussion of fiscally 
oriented approaches to measurement is to contrast 
them with the output measures just discussed. A short 
review of output measures should facilitate that com- 
Parison. 


Output measures indicate the quantity or level of ser- 
vice, the cost of the service, and the degree to which the 
service meets citizens’ needs. They stem from a recogni- 
tion that an organization should be evaluated, at least in 
part, in terms of its impact upon its environment. As 
compared to input measures, output or results oriented 
measures are far more useful in informing managers 
whether or not they are doing the right thing. They have 
their weaknesses, however, in that: 


1 they tell managers nothing about the processes 
which occur within the organization and do not 
supply a basis for evaluating those processes; 


2 they do not, by themselves, identify which service 
program, or approach to supplying a service, best 
meets community needs; 


3 they provide little flexibility for the consideration of 
environmental implications which may determine 
long-range costs or benefits of a service, and fre- 
quently do not even include the impact of immediate 
costs. For instance, in client response to service, the 
client is frequently unaware of either relative costs or 
potential alternatives; and 


4 while they can measure perceptions of change and 
indicate where change is needed, they cannot identify 
why an output has changed or indicate how the 
organization itself can be modified to create change 
where necessary. 


Fiscally oriented measures have the potential to combat 
at least some of those weaknesses. They are more long- 
term, planning oriented measures with both the costs 
and benefits of a service or program expressed in com- 
parable monetary terms wherever possible. Not only 
can the costs and benefits of a program be related to 
each other, but the relative costs and benefits of differ- 
ent programs or of different approaches to supplying a 
service are available for analysis. 


Although they are tied into program cost/benefit 
analysis the particular strength of fiscally oriented 
measures is in the relating of costs to output; they draw 
the accounting system into the management process 
and, ideally, provide managers with planning and 
evaluation tools. As part of this management process, 
fiscally oriented measures try to relate planning, activity 
programs, efficiency measures and impacts. By relating 


these various aspects of management they provide a 
vehicle for the allocation of resources. Thus fiscal 
measures provide the potential to bring performance 
evaluation into the management system, not simply as a 
measure of inputs, but as a measure of process efficiency 
and program effectiveness. 


These measures are linked to resource allocation 
through the medium of the budgetary process. Since a 
budget is a requirement in any organization and has 
become a particularly important aspect of local gov- 
ernment management, the budget process has been the 
focus of most fiscal approaches to measurement. With 
the growing awareness of organizational efficiency, the 
development of the application of systems theory to 
municipal organizations, and the associated need to 
rationalize decision-making in terms of outputs, it was 
realized that the budgetary process that existed, i.e. 
primarily measuring inputs, did not provide the right 
feedback or information for guiding the decisions of the 
council or the administration. 


Until the 1950’s the standard budgetary process was a 
line-by-line approach in which the input funds were 
identified and changes in unit budgets were made in- 
crementally. Incremental budgeting simplified the 
manager’s yearly task by focussing mainly on the small 
part of the budget which was not committed by previ- 
ous programs. Thus, the greater part of the budget, 
which included the ongoing programs involving 
maintenance and construction of basic physical ser- 
vices, ongoing social services, and long-term projects, 
was a stable base which remained substantially the 
same from year to year. Ongoing programs were not 
re-examined because costs alone did not provide a suffi- 
cient basis for that examination and, as a result, atten- 
tion focussed on increases and decreases which de- 
parted from the budget of the previous year. 


The incremental budgeting technique, more a ‘line of 
least resistance’ approach than a systematic technique, 
has been as much criticized as it has been widely used. A 
number of management surveys in the early 1950’s 
suggested a general dissatisfaction with line item 
budgeting and many complaints were registered. Typi- 
cal of the problems that were experienced with line 
budgeting are the following. 


1 The line item budget, in most cases, provided a re- 
cord of expenditure which could be readily under- 
stood only by its authors and by personnel in the 
finance department responsible for its implementa- 
tion. 
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2 It was difficult to understand how much was being 
spent on which activities. 

3 It was very difficult to discover which administrators 
were accountable for which portion of the budget. 
This was particularly true for the middle and lower 
level managers. 

4 It provided little, if any, of the information necessary 
to make intelligent spending decisions. Therefore, it 
did not encourage decision-makers to concentrate on 
questions such as the size of programs required, the 
relative importance of programs, etc. 

It had little to contribute as an aid to planning. 


6 It acted to limit participation of the elected level in 
the broader planning decisions which should have 
been a necessary part of the budget process. 


7 Itcould often help to alienate the administrator who 
was caught between finance department demands 
for detailed breakdowns of expenditure and the de- 
mands of the elected level for more clarity in the 
overall picture. Unable to provide convincing details 
by project or activity to an elected representative, 
who was at times under pressure to obtain this 
specific information, the administrator was forced to 
react defensively, and alienation between the two 
was often the result. This could seriously affect the 
outcome of future budget deliberations and lead to 
the end of rational budget debate. 


8 The line item budget made great time demands but 
often did not encourage optimum resource alloca- 
tion. With department heads (who were anxious to 
ensure adequate resources for necessary and desira- 
ble programs) meeting with elected officials (who 
were equally anxious to hold the line on continuing 
increases) the budget process involved confronta- 
tions, time consuming justifications, re-calculations, 
and lengthy debates ending, at times, in a flurry of 
last minute arbitrary decisions. This resulted in deci- 
sions being based on the cost factor alone with little 
or no consideration being given to the purpose of the 
service being supplied or to the benefits of that ser- 
vice. 

9 The line item budget could also be critized for its 
failure to consider expenditures as a whole, its inher- 
ent lack of co-ordination in budgeting resources, and 
the wasteful prolonging of obsolete and ineffective 
or inefficient programs. 


Various attempts have been made over the past twenty 
years to modify the budget process to integrate more 
meaningfully with managers’ ongoing needs for finan- 
cial information. These different attempts can be de- 
scribed under three general headings. 


1 Performance budgeting; 
2 Planning, programming budgeting; and 
3 Zero based budgeting. 


Each of these approaches will be discussed in some 
detail. 


1 PERFORMANCE BUDGETING 


Performance budgeting was introduced into govern- 
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ment over twenty years ago and has since been superse- 
ded by a number of other approaches, e.g. planning, 
programming budgeting and management by objec- 
tives. Though its popularity with public service ad- 
ministrators has diminished over time, its basic ele- 
ments have been retained by more recent, elaborate and 
comprehensive systems. 


STRENGTHS 


Performance budgeting in the United States grew out of 
an interest in performance measurement. It was for- 
mally recognized and became popular as a working 
management concept in government as a result of the 
1949 Hoover Commission. The purpose of this federal 
body was to recommend efficiences and improvements 
in the formulation of federal budgets. The commission’s 
chief recommendation was that the adoption of the 
budget should be based on functional activities and 
programs and that it should be treated as a ‘perfor- 
mance budget’ in which an increased accountability for 
efficient execution of programs was to be delegated to 
all levels of management. One of the main benefits cited 
for this new system was an improvement in the quality 
of decision-making by both administrators and elected 
officials. 


This improvement would be achieved through the de- 
velopment and implementation of a feedback system 
involving the setting of throughput and efficiency 
measures for the delivery of services. This idea, rela- 
tively new at the time, resulted from a greater awareness 
of the budget as both a powerful control instrument and 
as an expression of political commitment. With this 
growing awareness, the old style line item budget 
rapidly fell into disrepute, at least at the federal level. 
With the increase in use of performance budgeting in 
the 1950’s there was a strong feeling that the problems 
encountered with the old style line item budget would 
be rectified. 


Performance budgeting differed from the traditional 
line item budget in that the main thrust of performance 
budgeting was in the emphasis placed on accountability 
and achievement. Thus, one of the most important as- 
pects attributed to the system was its ability, where 
properly implemented, to promote a sense of responsi- 
bility and concern for achievement on the part of ad- 
ministrators. It was intended that performance budget- 
ing should focus on the delivery of services and on work 
programs and activities, accurately accounting for 
operating requirements in terms of men, money and 
materials for specific functions, and in all cases directly 
identifying responsibility for accomplishment. Simply 
stated, it was supposed to set forth what was to be done, 
who was responsible for doing it, and what the costs 
were — both past and projected. 


The following represent some of the reasons why per- 
formance budgeting was considered an improvement 
over line item budgeting. 


a It provided for tighter control over expenditures by 
the elected level. ! 


b It helped to improve planning. 


c It made decision-making a simpler task which relied 
more on fact than guesswork. 


d It helped to decentralize decision-making, placing 
authority at the level of responsibility. 


e It also served as a useful communications device, 
helping to improve relations with interested citizens’ 
groups and others interested in how municipal funds 
were being spent. Clear statements of where public 
money was going and what was being accomplished 
with that money also served to lessen the suspicions 
and the distance which often separated the views of 
citizens vis a vis council. 


f It allowed for a closer examination of managerial 
efficiency in executing municipal programs. 


Briefly, the main steps involved in implementing per- 
formance budgeting are as follows. 


a The development of a functional classification of 
municipal services performed by the work unit in- 
volved. A sample breakdown might look like the 
following; 


General function Transportation 


Department Public Works 


Activity (Program) Road Design and 
Construction Branch 
Sub activity Installation 
(cost accounting 

and work unit 

description 

for all levels) 


b The specification of work unit plans ofaction for the 
coming year, detailing the scope and estimated cost 
of proposed work. 


c The specification of personnel requirements either 
through determination of total man hour needs or 
unit cost accounting. 


d The establishment of a relationship between the vol- 
ume of work performed and the manpower used to 
achieve that volume, using measures of output and 
measures of employee time. 


e The implementation, through a cost accounting 
function, of a performance reporting system which 
will indicate trends in program accomplishment and 
resource usage. The purpose of the performance re- 
porting system is to determine whether or not the 
annual departmental work programs are being ac- 
complished in an efficient and timely manner and to 
highlight problem areas. 


The cost accounting function is a key factor in a per- 
formance budgeting system. Briefly, the system is or- 
ganized such that costs are accumulated by major work 
activities at the department level. Cost information is 
then further broken down in manpower and managerial 
categories for subdepartmental levels. Costs are, as far 
as possible, related to workload, e.g. dollars per ton of 
garbage removed, dollars per ton of asphalt laid. These 
standards can then be used to evaluate performance. 

Typical feedback procedures resulting from cost ac- 


counting data involve monthly performance budget 
print-outs of throughput, cost figures, and the combin- 
ation of these into efficiency measures. 


WEAKNESSES 


The need for an elaborate accounting system has been 
pinpointed as one of the disadvantages of performance 
budgeting. Critics argue that unless.an elaborate, ex- 
pensive, cost accounting system is included and related 
to managerial responsibility, performance budgeting 
loses its significance, either through a lack of accuracy 
in performance feedback, or through a lack of depth 
and completeness in a system which should provide 
useful performance measurement data for all levels of 
management. Others argue that a cost accounting sys- 
tem creates an overabundance of data which are tail- 
ored to very few people, used by even fewer, and 
amounts to a proliferation of paper and an unjustifiable 
need for more manpower to produce data. 


Many of the criticisms of performance budgeting were 
not aimed at the concept of performance budgeting but 
at the management of the back up accounting system. 
Other criticisms were that it was not always easy to 
define costs, quantities and work units. The concept 
itself, however, was well received. Even though perfor- 
mance budgeting as a system has lost popularity over 
the years, the concepts behind it have not been forgot- 
ten; they have been updated, refined and incorporated 
into more relevent systems. Components such as cost 
accountng systems, quantified work measures, stream- 
lined budget processes and increased program accoun- 
tability are still in wide use today. 


2 PLANNING, PROGRAMMING BUDGETING 


The 1960’s saw a tremendous increase in activity in the 
area of budgetary reform in both business and govern- 
ment. At the forefront of these reforms was a system 
called the planning, programming budgeting! (PPB) sys- 
tem. This was a popular successor to performance 
budgeting and it developed and incorporated many of 
the components of the earlier system. 


PPB is a system designed to help managers to attain the 
objectives of the company through a better selection of 
alternatives for the allocation of resources. Its purpose 
is to develop and present information in a meaningful 
way, giving the full implications — costs and benefits 
— of each of the alternatives being considered. It rep- 
resents a further attempt at rationalizing decision- 
making, by trying to minimize the amount of frag- 
mented, incremental and last minute planning and 
budgeting occurring in government organizations. 


The pps system has been described as follows. 


Planning — assessing the community needs, setting 
objectives and choosing the means of attaining them 
from among the available alternatives. 


1 ppBalso gave rise to anumber of related but simplified or modified 
budgeting systems such as program budgeting. Program budget- 
ing is sometimes used interchangeably with prs. For the purposes 
of this paper, however, program budgeting denotes a budgeting 
system which emphasizes a program structure but does not in- 
clude the multi-year perspective or cost/benefit analysis of PPB. 
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Programming — organizing and controlling specific 
courses of action in relation to the objectives they 
service and presenting them in a performance and 
resource use plan over a period of years. 


Budgeting — translating planning and program- 
ming decisions into specific financial plans for a 
relatively short period of time (one year). 


System — integrating, checking and reviewing all 
planning, programming and budgeting decisions 
within a consistent framework of general 
management.? 


It can be seen that the ppp system expands the scope of 
the budgeting process from the simple financial control 
role adopted by the line item budget. Under pps the 
budget becomes an integral part of the total manage- 
ment system. Novick? has isolated ten major distinctive 
features of a management system which are incorpo- 
rated by pps. These are as follows. 


a Definition of an organization’s objectives as specifi- 
cally as possible. 


b Determination of programs, including possible al- 
ternatives, to achieve the stated objectives. 


c Identification of major issues to be resolved in the 
formulation of objectives and/or the development of 
programs. 


d Analysis of programs and their alternatives in terms 
of probable outcomes and both direct and indirect 
costs. 


e An annual cycle with appropriate subdivisions for 
the planning, programming and budgeting steps to 
ensure an ordered approach and to make approp- 
riate amounts of time available for analysis and 
decision-making at all levels of management. 


f Development of the analytical tools necessary for 
measuring costs and benefits. 


g Adaptation of existing accounting and statistical re- 
porting systems to provide inputs into planning and 
programming, as well as providing continuing in- 
formation on resources used in actions, and on ac- 
tions taken to implement programs. 


h Recognition of issues and other problems that re- 
quire more time than is available in the annual cycle 
so that they can be explicitly identified and set apart 
from the current period for completion in two or 
more years, as the subject matter and availability of 
personnel require. 


1 Developmenteach year of a multi-year program and 
financial plan with full resource allocations in the 
early years. 


j Continuous re-examination of program results, in 


2 Department of the Director-General, Greater London Council, 
Some Questions and Their Answers on the Greater London 
Council’s Planning Programming, Budgeting System, (London, 
England: Greater London Council, April 1972), p. 8. 

BEES 8, 

4 More comprehensive examples of program details and process 

format for the cities of San Diego, California and Lakehead, 

Illinois, are given in Appendix I. 
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relationship to anticipated costs and outcomes, to 
determine the need for changes in stated programs 
and objectives as originally established. 


From these ten distinctive features of this total man- 
agement system, four major components of a PPB sys- 
tem can be identified — a program structure cutting 

across departmental lines, a multi-year program and 
financial plan, program analysis, and a revision and 

updating procedure. Each of these will be explained in 
some detail. 


i Program structure 


pps begins with an effort to identify and define the 
fundamental functions of the particular governmental 
jurisdiction or the chief purposes for which that gov- 
ernmental unit exists. The goals, or key result areas, 
where efforts must be directed to achieve those pur- 
poses need to be established and the programs required 
in each goal area determined. This requires grouping by 
output (or result area) rather than, as in traditional 
budgeting, by line items of input. Since several depart- 
ments may contribute to certain programs, the prog- 
rams cut across departmental boundaries to draw to- 
gether the information and resources needed by the 
primary decision-makers. 


Analysis, the hallmark of the PPB system, is important at 
the program structure stage. Examining the organi- 
zation’s goals and objectives, selecting the most effec- 
tive set of concurrent goals and objectives, identifying 
programs and program elements, and considering 
priorities, are all activities to be undertaken at this 
stage. 


An abbreviated example ofa PPB program structure for 
a local government is presented below. It is taken from 
the fiscal year 1974 budget of Charlotte, North 
Carolina. Only two category levels are shown here. 
More levels are needed for a complete program struc- 
ture which would show the applicable individual 
activities. 4 


CHARLOTTE, NORTH CAROLINA — PROGRAM STRUCTURE 


1 Community Development Program 


11 Environmental Health and Protection Program 
(examples of second level programs) 


Refuse Collection 


aT 2 


Refuse Disposal 


Street Cleaning 


a0 


Cemeteries 
Water supply and Treatment 


Wastewater Collection, Treatment and Disposal 


Odor Monitoring and Control 


>— 7 ms oO 


Utilities Administration 


a 


Support to Programs Contributing to Environ- 
mental Health and Protection 


11 Protection of Persons and Property Program 


IV Transportation Program 


V_ Leisure Time Opportunities Program 


vi Policy Formulation and Administration Program 
it Multi-year program and financial plan 


The main product of a PPB system is a comprehensive 
multi-year (usually five year) program and financial 
plan, for each agency or department. This plan is 
periodically and systematically updated. An essential 
early step is the establishment of performance oriented 
categories that cover the total work and area of respon- 
sibility of each department. This is in contrast to the 
traditional input oriented municipal budget which fo- 
cuses on the amount of increase required to meet rises in 
annual expenses. 


The function of the program and financial plan has been 
well described by Millward:> 


The Program and Financial Plan (PFP) of each agency 
is to be a quantitative statement of the agency’s 
programs, according to the various functions that it 
performs. The pFp should express objectives and 
planned accomplishments in quantitative physical 
(output) and finance (input) terms. The intended 
function is to reveal some of the future year implica- 
tions of current budget decisions. It should also 
group programs in such a way as to facilitate com- 
parison among similar programs. As the PFP will 
assist in pulling together all of the costs associated 
with decisions to carry out given programs ata given 
level, it will thus facilitate decision-making. It will 
also help to force choices among programs, particu- 
larly because not all of the potential agency activities 
can be accomplished with the resources available. 
iii Program analysis 
The pps system of decision-making requires that an 
organization have a systems analysis capability so that 
the resource and cost implications of program alterna- 
tives, and their expected results or outputs, may be 
estimated, examined and compared. Indeed, the sys- 
tematic identification and anlysis of alternative ways to 
achieve the goals and objectives of the organization is 
one of the basic elements of PPB systems. 


A wide range of tools and techniques drawn from the 
fields of economics, operations research, mathematics 
and computer sciences are employed in program 
analysis. These include statistical analysis, gaming, 
modelling, simulation, operations analysis and 
econometrics. The terms ‘cost/benefit analysis’ and 
‘cost-effectiveness analysis’ are often used to describe 
studies using these tools and techniques. 


Quantification is sought, whenever possible, to monitor 
and measure the value of programs. When quantitative 
measures are not available, qualitative analysis is un- 
dertaken. However, program analysis is not merely the 
robot-like application of well defined analytical techni- 
ques to a predetermined set of alternatives. Often, the 
analysis of several obvious alternatives will lead the 
creative analyst and/or decision-maker to the invention 
of several less obvious but possibly more cost effective 
alternatives. 


iv Revision and updating procedure 


The PPB system must be responsive to the changing 


needs of its users and to changing information. Thus a 
procedure that allows for the revision and updating of 
resource decisions is essential. Program analysis will 
often provide new proposals and impetus for change. In 
the interests of initiative and administrative efficiency, 
thresholds are often established below which organiza- 
tional units may make changes in program and financial 
plans without requiring approval from above. 

PPB has its roots in a number of management tools 
developed in industry as early as the 1920’s, but the 
characteristic form emerged out of a number of con- 
cepts and techniques which were introduced during and 
since World War 11. In 1961 the United States Depart- 
ment of Defense, under the tutelage of Robert S$. Mac- 
Namara and a number of recruits from the Rand Cor- 
poration, became the first major governmental organi- 
zation to implement a PPB system. Due to its success, 
and President Johnson’s recognition of the need for a 
more rational method of public resource allocation, 
Johnson ordered all u.s. federal agencies to implement 
the system in August, 1965. 


The movement was by no means limited to the United 
States. Research on, and development of the system, was 
simultaneously being carried out in the United King- 
dom and several other nations. By 1970 almost every 
Western national government, including that of 
Canada, had installed a pps or related system.® 


Since the mid-sixties numerous local governments have 
invested heavily in implementing PPB systems. Local 
governments of all sizes in the United States and Eng- 
land led the way in what became almost a ‘bandwagon’ 
effect. Many encountered difficulties which, in retros- 
pect, could have been avoided. Some municipalities 
moved too quickly, others too slowly, and others acted 
without adequate understanding or acceptance of the 
process by administrators and elected representatives. 
The future benefits of the system were often oversold, 
resulting in widespread skepticism when difficulties 
were encountered. As a result, pPB suffered a decline in 
popularity in the early 1970’s. A number of muni- 
cipalities, including New York City and Philadelphia, 
while still making use of the PPB concepts, either sub- 
stantially modified the system or sought out some other 
budgetary method. Even the u.s. Federal Government 
decreased its emphasis and reliance on pps. Despite 
these well publicized defections, however, ppB and 
especially its off-shoot, program budgeting, have con- 
tinued to gain disciples. 


When applied to local government, however, PPB does 

encounter difficulties which are inherent in the system 
and in organizational change in general, rather thanina 
faulty implementation. These problems present hurdles 

that must be overcome if the system is to become fully 
operational.” 


5 46, p. 90. 

6 Descriptions of the national government PPB experiences of Au- 
stralia, Austria, Belgium, Canada, the United Kingdom, France, 
Ireland, Japan and New Zealand are presented in chapters 6-17, 
Of oie 

7 Specific problems associated with the implementation of Pps in 
the cities of Cincinatti, Los Angeles, and Phoenix are discussed in 
Appendix 1. 
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Technical problems 


The first step in a PPB system is the establishment of 
goals and objectives. In local, as in other levels of gov- 
ernment, this is a difficult process presenting a number 
of problems. To be meaningful, the process must begin 
at the top with a clear definition of corporate purpose. 
Goals, which represent direction, and objectives, which 
represent some broad targets, need to be set or ap- 
proved by council and based on the feelings of the 
public as to desired services and priorities. It is hard for 
a representative body, such as council, to reach a con- 
census and then to clearly articulate that concensus in 
the form of corporate goals and objectives." Commit- 
ment to corporate approaches and expertise in corpo- 
rate management are often lacking at the council level 
and, in fact, the corporate purposes fulfilled by a muni- 
cipality are often not clear either to councillors or to 
administrators. Even when the purpose is clear and 
goals and specific objectives have been identified, it is 
often not clear how best to achieve them. 


Deficiencies in performance measurement systems and 
difficulties of quantification are only two of the many 
problems involved with the analysis part of ppB. Local 
governments often lack the analytical capabilities re- 
quired to carry out detailed cost/benefit analyses of 
alternative programs. Many critics of local government 
pps have argued that it is unrealistic to expect that a 
system that was only somewhat successful in a huge, 
analysis-oriented u.s. federal agency (the Department 
of Defense), and less successful in other agencies, would 
find success at the local government level. They suggest 
that PPB is an extremely well-ordered, complex system, 
requiring expertise not available in less sophisticated 
municipal governments. 


Another problem is that there is a tradition of func- 
tional independence in local government. Support de- 
partments, or segments of departments which carry out 
support functions, are frequently out of touch with the 
departments they support. Thus, when the finance de- 
partment wishes to introduce a new financial manage- 
ment system which requires the consensual support and 
involvement of line managers, neither the integrative 
mechanisms nor the motives to produce integrated 
programs are present. To introduce a management sys- 
tem without full line managerial involvement is clearly 
difficult and can result in alienation between finance 
and operational managers if the issue is forced. We are 
not aware of any PPB system which fulfills its manage- 
ment potential for both line and financial staff mana- 
gers. 


Problems in making the change 


Even in jurisdictions where the problems discussed 
above did not exist or have been substantially over- 
come, success has not automatically followed. First, 
there has always been a considerable shortage of trained 
and motivated personnel available to help local gov- 


8 A good example of a program that was successful in articulating 
agreed upon community goals is Goals for Dallas, described in 
two case histories listed on the order form on the last page of this 
publication. 


36 


ernments implement Pps. Second, the political envi- 
ronment (both internal and external) has not always 
been conducive to the new system. The latter has proven 
to be the more serious problem. 


Besides being merely a change from the old ways of 
doing things, the ppB system seeks to identify and re- 
move overlapping and redundant activities, to expose 
the inefficient or ineffective use of resources, and to 
illuminate the long-range cost implications of proposals 
with relatively low initial expenses. This exposure can 
be threatening to insecure managers. Add to this the 
skepticism generated by gross overestimates of the be- 
nefits and underestimates of the time and effort re- 
quired to have the system operational, and all the ingre- 
dients necessary for widespread resistance to the change 
are present. The changes brought about by a PPB system 
are bound to jeopardize the vested interests of a number 
of groups which will often resist and perhaps attempt to 
sabotage the system in a number of ways. 


Any movement towards a PPB system is usually seen by 
line managers as an attempt by finance people to gain 
more control over them, and this is met with resistance. 
Line managers have trouble defining and thinking in 
terms of programs, particularly those set up across de- 
partmental lines. Unless the system is initiated and fully 
supported by council and top management, it will be 
seen by line managers as a budgeting control device 
rather than as a system to aid in the decision-making 
process. To implement PPB or, in fact, any goal and 
objective based system, a great deal of rather specific 
management education is necessary. The LGMP experi- 
ence indicates that a proactive advisor needs to be con- 
tinually available at the outset to emphasize the impor- 
tance of system development, or any complex man- 
agement improvement initiative will probably fail. 


Failure to take these factors into account and to act on 
them can result in budgets that are program budgets on 
paper only, with no real ppB systems behind them. 
There are many such pseudo program budgets for every 
true PPB system in effect in local government. 


Notwithstanding the inherent difficulties in implement- 
ing a PPB system and the crippling problems encoun- 
tered by some municipalities, there have been many 
notable successes with the system and its off-shoot, 
program budgeting. Municipalities that have developed 
the process carefully and thoughtfully have found the 
system to havea number of advantages. Not the least of 
these is the improved communication and mutual plan- 
ning process which must develop early in the program. 


Several British local governments have been quite suc- 
cessful with pp. Substantial progress has been made by 
the Greater London Council and the municipalities of 
Islington and Liverpool, among others. Rather than 
limiting budgetary reform to improvements in the 
budgeting system, a number of British local govern- 
ments have implemented ppp as a stepping stone to the 
corporate planning process. 


Phoenix, Arizona; Dayton, Ohio; Charlotte, North 
Carolina; Fort Worth, Texas; and Dubuque, Iowa are 
five examples of American cities which had success 
with pps. More local governments have been joining 


their ranks every year. In Canada, both Calgary and 
Edmonton have embarked on program budgeting, ap- 
parently with some initial success. 


A number of Ontario municipalities have moved in the 
direction of program budgeting by undertaking a more 
modest type of budgetary reform. This has involved an 
orientation of the budget toward the grouping of finan- 
cial allocations by program area, thus focussing atten- 
tion on programs rather than on line items. Two 
municipalities involved in such reform are London and 
Ottawa but neither city has developed the type of co- 
operation necessary among departments to produce a 
full fledged program budget, containing clear objectives 
for each program. 


3 ZERO BASED BUDGETING 


Following the rise and fall of enthusiasm for planning, 
programming budgeting, the zero based budgeting 
(ZBB) approach promises to reignite widespread at- 
tempts at increasing the effectiveness of the budget pro- 
cess. By mid 1977, zero base budgeting was being used 
by more than 200 companies, 11 states and a number of 
local governments in the United States. (In addition, 
ZBB is to be implemented throughout the u.s. Federal 
government in the preparation of the 1979 budget.) 
Known users of the process in Canada thus far include 
Westinghouse, The Bank of Montreal, McMaster Uni- 
versity, and the Canadian Broadcasting Corporation.?® 


The basic concept underlying zBB is a simple one. It 

consists of the simultaneous organization-wide exami- 
nation of all programs in their totality. Under this sys- 
tem each program must compete for funding authoriza- 
tion on the basis of its cost/benefit value compared with 
all the other programs also in competition for scarce 

resources. Through an extensive system of review and 
prioritization, obsolete programs which have continued 
through inertia or by design, or programs which should 
no longer be continued at the same level, are highlighted 
and either cut from the budget or cut back as required. 
Theoretically, the merits of all programs in all depart- 
ments are weighed one against the other, a cut-off line is 
negotiated and programs significantly below the line 

are dropped. 


ZBB, therefore, represents a further attempt to tie the 
internal financial resource allocation system to prog- 
ram management. In this respect it is similar to the other 
fiscal approaches. ZBB’s basic difference is that there is 
no incremental portion of the budget. This means that 
no budgeting decisions are made automatically. For the 
purposes of this system, programs have no 

history — only a future. 


The earlier attempts at performance budgeting led to 
the concept of the two-part budget. Under this concept, 
one part of the budget represented ongoing activities 
over which senior managers had little control or which 
involved no change from the previous year. This, essen- 
tially, was the base for the following year’s budget. The 
other part of the budget represented those aspects 

which should be considered by the senior managers at 
that time. Zero based budgeting concentrates on the 
latter part and expands that base to represent the 

budget in total. Consequently, each and every program 


is examined and approved afresh at each budget cycle. 
This is the basic contribution of zero based budgeting. 


WEAKNESSES 


It is not difficult to surmize that one of the criticisms 
leveled against zBB is the inordinate time investment 
because of the necessity to generate a good deal of 
paperwork. For any organization which has a solid slate 
of objectives for each program, zero based budgeting 
should not be an onerous task, but it is clear that few 
organizations have developed prioritizing based on 
comprehensive objectives to a sufficient degree to facili- 
tate this task. 


Another complaint about this system concerns the ten- 
dency of managers using ZBB to develop a short-range 
perspective. Since long-range programs have no i1m- 
mediate pay-off and consequently do not look espe- 
cially valuable when weighed against a shorter term, 
higher priority program, there is a tendency to let long- 
term programs drop or to stress the short-range objec- 
tives of programs in general. 


A third problem sometimes cited has been the difficulty 
in maintaining a non-threatening atmosphere, as the 
process has developed a reputation for exposing 
‘cushioned’ budget areas. Particularly where priorities 
are somewhat in doubt, insecurity can become quite 
common. 


Finally, in the public sector it has been argued that the 
system can be used by politicians as a way of delegating 
responsibility to administrators for making budget cuts 
in sensitive areas. This is a criticism of the use being 
made of the system and not of the system per se. 


Asis the case with every other system, managers operat- 
ing under threat will find a way to obscure the real value 
ofineffective programs. Unless they have clear program 
goals and objectives, the effective use of zero based 
budgeting is questionable. The imposition of zero based 
budgeting can force the generation of objectives but 
those objectives may not be meaningful. Thus zero 
based budgeting is only truly effective where there is 
already an effective management system. 


STRENGTHS 


In spite of these potential shortcomings, proponents of 
the ZBB approach claim a number of advantages. Speci- 
fically attributed to the zBB approach is the contention 
that, when rightly used, the system forces managers to 
identify feasible alternative ways of providing prog- 
rams. This encourages the development of creativity 
and initiative. Also, those managers closest to the im- 
plementation of programs have more influence in select- 
ing areas where budgets can be cut, and in selecting 
areas where the budget should be increased. Other more 
general strong points include the fact that ZBB increases 
managerial awareness of the cost per unit of output, and 
increases the involvement of top and middle manage- 
ment in the decision-making process. 


9 Further details of Westinghouse and McMaster’s experiences with 
structuring and implementing zBB programs are given in Appen- 
dix I. 
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One of the advantages of zB in the private sector is that 
all programs are re-justified with each setting of the 
budget. Thus all programs are, at the outset, equally 
open to curtailment or dissolution. This cannot be so in 
the local government situation since many of the prog- 
rams — sewers, roads, sanitation, etc. cannot be disman- 
tled. For these mandatory areas, however, the ZBB pro- 
cess would be useful in that it would force managers to 
think of alternative ways of providing these services. To 
streamline the process in the municipal setting, it would 
probably be preferable at the outset to designate specific 
programs as being automatically above the cut-off line. 
This would eliminate wasted time in justifying an obvi- 
ously necessary program. 


Another alternative would be to use the zBB approach 
on aninterval basis, every two or four years. In interven- 
ing years the standard budgeting format could be used. 
This would eliminate what many consider to be overuse 
of an apparently powerful yet time consuming process. 


Another alternative which has attained a good deal of 
popularity is the assessment of a proportion of prog- 
rams each year. This however, partially destroys the 
basic strength of the zBB approach because all prog- 
rams are not judged against all other programs to de- 
termine priorities. Priority determination is a funda- 
mental aspect of the concept. 


There is currently not much material available which 
assesses the results of public or private sector attempts 
at using ZBB. Hopefully, as the results of the many 
current ZBB efforts are recorded, a better understanding 
of the contribution of different zBB implementation 
methods will be possible. Our forecast would be, how- 
ever, that ZBB will experience the same hazards as prog- 
ram budgeting. Serious attempts at ZBB are dependent 
upon effective management systems in all areas of the 
administration. Unless managers have goals and objec- 
tives and are able to measure the impact of programs in 
all the ways previously described, zBB will have little 
real effect. Managers will learn to ‘play’ any externally 
imposed control system with great alacrity and exper- 
tise if it is not seen as an integral part of their every day 
management needs. 


SUMMARY 


One of the problems involved in developing a chronol- 
ogy of budgetary processes results from the fact that 
each municipality develops a budgeting procedure 
which is in some way unique, as a reaction to specific 
management needs and systems of operation. Conse- 
quently, the approaches discussed here do not set out to 
explain or describe specific systems in operation but 
merely outline general directions of thinking. 


It can be seen, however, that each of the approaches 
outlined here recognizes the need for a process of effec- 
tive management and encourages the development of 
procedures to pursue that goal. Each approach essen- 
tially requires a management system involving goals 

and objectives on a program basis, some processes for 
the selection and prioritization of alternative programs 
and a definitive procedure to aid in allocating the neces- 
sary resources. As opposed to line by line budgeting, the 
more recent approaches do not assume a special rela- 
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tionship with the past but, in fact, reflect a movement 
away from a consideration of past expenditures. They 
require that the activities to be accomplished need to be 
established first and then the budget is developed to 
supply the necessary resources. Consequently, each ap- 
proach is an attempt to place the budget in a context of 
effective management or perhaps, in many Cases, to 
control management processes by means of the budget. 
Certainly, the primary motivation behind the budgetary 
reform movement is to speed up the budget process and 
to make the procedure, and the information that flows 
from it, more useful to line managers, finance depart- 
ment staff and elected representatives. 


Ascan be seen, fiscally oriented approaches can be very 
effective when they incorporate output and program 
performance measures. They allow for the allocation of 
available funding on a logical and objective basis rather 
than on an arbitrary and subjective one. They clarify 
performance measures and organizational roles, high- 
light cross-divisional or cross-departmental problems 
and opportunities and, in general, help to provide the 
feedback necessary for effective management. 


As noted, however, each has its own inherent problems. 
This being the case it should be borne in mind that the 
budgeting procedure must be designed to suit the needs 
of effective management in each municipal organiza- 
tion. This means that a consideration of effective man- 
agement must precede changes in systems and proce- 
dures. If management needs are not given a thorough 
analysis before the establishment of a budget proce- 
dure, the procedure may later be abused, it may not be 
as valuable as it could be, and it may be a function of 
fashionable technique rather than a step towards a solid 
improvement in management. 


When properly applied, these approaches reflect an 
attempt to modify an organizational system to improve 
decision-making and to facilitate effective manage- 
ment. As has been stated, one of the major findings of 
the LGMP experience has been that this whole area of 
objective determination and evaluation of results is one 
of the most poorly handled management aspects in local 
government and one that has been neglected as a focus 
for management performance measurement. The next 
section will deal with this topic in some detail. 


Program Oriented Measures 


As discussed in the introduction to this paper, the past 
decade has witnessed a fundamental change in ideas 
about public expenditures from considerations of con- 
cern over financial inputs to focusing on what the ex- 
penditures were intended to achieve, i.e. outputs. This 
increasing interest on outputs, results and effects led to 
experimentation with financially oriented measure- 
ment systems such as PPB in many jurisdictions. With 
the proliferation of government programs in the late 
1960’s and early 1970’s the measurement of the effec- 
tiveness of those programs became increasingly impor- 
tant. Elected officials wanted to be sure that money was 
being used to best advantage while administrators were 
also concerned with justifying their role and performing 
the appropriate function. Hence the concept of prog- 
ram evaluation flourished. 


‘Program evaluation’ refers to the assessment of costs 
and effectiveness of ongoing government programs to 
determine how successful they have been in contribut- 
ing to the goals and objectives of the jurisdiction. It 
provides information to the decision-maker that might 
suggest that a program be retained, expanded, mod- 
ified, reduced in size, or even dropped. The results of 
program evaluation can also be used as input to a full 
program analysis that looks at the future costs and 
benefits of various alternatives. 


Regular evaluation of the effectiveness of programs in 
meeting the public’s goals and objectives is an impor- 
tant part of local government management. Evaluation 
can provide a reliable guide to managers in making 
program decisions, and sometimes it can indicate 
changes that will make programs more effective. Unfor- 
tunately, however, full program evaluations are seldom 
carried out on a regular basis by local government 
organizations. A basic problem is that the purposes of 
the programs are seldom adequately defined. In addi- 
tion, cost, lack of evaluative expertise, uncertainty, lack 
of interest, lack of confidence in the techniques, and fear 
of possible unflattering results, are some of the factors 
that seem to hold local governments back from com- 
prehensive program evaluation. 


This section of the paper looks at the scope of program 
evaluation, some of the inadequate methods of evalua- 
tion currently in use in local government, and the essen- 
tial components of program evaluation. Several of these 
components are then discussed in greater detail, includ- 
ing evaluation criteria, evaluation design, and sources 
of data. Some suggested criteria for deciding when to 
undertake a program evaluation are presented and 

some of the problems inherent in program evaluation 


are considered. The section ends witha short discussion 
on the allocation of responsibility for program evalua- 
tion. 


SCOPE OF PROGRAM EVALUATION 


Program evaluation has been described and defined ina 
number of ways not all consistent with each other. The 
four descriptions below are representative and suffice to 
bring out the major characteristics of program evalua- 
tion. 


By program evaluation we mean assessment of the 
impact of past and present programs, projects and 
project components (‘treatments’). Program evalua- 
tion attempts to determine what the government and 
people have been getting for their money: What 
works? What doesn’t work? What have been the 
effects of past and present programs and projects? 
What factors are associated with success or failure of 
programs or projects?! 


Program evaluation is the systematic examination of 
specific government activities to provide informa- 

tion on the full range of the program’s short and long 
term effects on citizens. While a program evaluation 
may include consideration of workload measures, 

operating procedures, or staff, its chief focus is on 
measuring the program’s impact or effects.” 


The purpose of program evaluation is to determine 
the operations and effects of a specified program 
— relative to the objectives it set out to reach — in 
order to contribute to the effectiveness of decision- 
making surrounding the program.? 


(Program evaluation is) ... the systematic accumula- 
tion of facts for providing information about the 
achievement of program requisites and goals relative 
to efforts, effectiveness, and efficiency within any 
stage of the program. The facts of evaluation may be 
obtained through a variety of relatively systematic 
techniques, and they are incorporated into some de- 
signated system of values for making decisions about 
social programs.4 


All commentators appear to agree that program evalua- 
tion is something that is carried out ‘after the fact’. 
Taken in this context program evaluation would look at 


USS joy Ziel 
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Tony Tripodi, Phillip Fellin and Erwin Epstein, Social Program 
Evaluation: Guidelines for Health, Education and Welfare Ad- 
ministrators, Itasca, Ill.: F.E. Peacock Publishing Co., 1971, 
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actual past performance and attempt to determine 
whether the program accomplished what it set out to do 
during a stated interval or during the full life of the 
program, and in what ways citizens are better or worse 
off as a result of the program. Program evaluation 
differs from the ongoing monitoring of performance 
discussed in the first part of this paper in that it attempts 
to identify effects that can be attributed to specific 
programs. On-going performance measurement shows 
trends and general changes and does not try to separate 
out the program components of the change from the 
non-program components of the change. 


COMMENTARY ON DEFINITIONS 


Certainly the overall reason for program evaluation is 
the determination of the program’s impact upon its 
clients, whether those clients are the public, other or- 
ganizational units, or other organizations. To an extent, 
it appears that all of the foregoing definitions are inade- 
quate. None of them define the full scope of the function 
of program evaluation. First, that impact should be 
compared with the stated purpose of the program, to 
see whether or not that purpose is being fulfilled. Sec- 
ond, evaluation should be made to determine whether 
or not the program is achieving its stated objectives. If it 
is, and it is still not having the desired impact on the 
public, then there is a management problem to be rec- 
tified. If it is not achieving its objectives, the third step 
is to find out why. Fourthly, a program should be 
evaluated to ensure that it is using resources efficiently 
and that it is fulfilling its role as efficiently as possible. 
This is perhaps the most difficult aspect to evaluate and 
can only really be carried out effectively by the mana- 
gers responsible for the program being evaluated. 


INADEQUATE METHODS OF EVALUATION 


Most local government managers make some type of 
review of their programs every year. Several of these 
methods of review and their inherent deficiences have 
been identified by Hatry et al.® 


1 Hearings with Program Managers — complete ob- 
jectivity can not be expected, the effects of programs 
on the users are often neglected. 


2 Examining Program Statistics — data usually focus 
on inputs rather than outputs, measurement usually 
is not reflecting impact on the public and changes in 
data from one period to another are seldom sys- 
tematically related to specific programs. 


3 Application of Professional Standards — again usu- 
ally expressed in terms of inputs not outputs, e.g. 
hospital beds per capita or case loads per welfare 
worker, thus failing to show impact on the public. 


4 Evaluating Citizen Complaints — not likely to be 
representative of the total community, difficult to 
judge the extent of the problem. 


The above methods also fail to provide information on 
the long-term benefits of the program or on the way the 
program affects different segments of the population. 


> 2038 yp. 13. 
6 108, pp. 23-27. 
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Done properly, program evaluation can overcome all of 
the deficiencies mentioned above. There are, however, a 
number of problems with program evaluation, which 
will be discussed later, that explain why it has not been 
as boldly embraced by local government managers to 
date as one might have expected. 


THE ESSENTIAL COMPONENTS OF PROGRAM 
EVALUATION 


Four important elements of program evaluation are: 


1 the identification of program purpose; 
2 the identification of program goals and objectives; 


3. the identification of evaluation criteria or measures 
of efficiency and effectiveness; and 


4 the identification of the segments of the population 
or organization affected by the program. 


Hatry et al. make the following suggestions regarding 
the latter three elements.® 


1 Develop people oriented goals, objectives and evalu- 
ation criteria to reflect the impact on the users of the 
service and/or the community. 


2 Consider possible unintended consequences of prog- 
rams, particularly negative effects, and incorporate 
them into goals, objectives and evaluation criteria in 
order to place the overall worth of the program in 
perspective. 


3 Each program and sub-program will require a 
number of objectives and measures of effectiveness. 


4 Evaluation criteria should not be rejected simply 
because of apparent difficulties in measuring 
them — there is usually some way to measure even 
the most qualitative evaluation criteria. 


5 Distinguish program effects on specific elements of 
the client population based on classification criteria 
relevant to the program, including such criteria as 
residence location, sex, age, income group, educa- 
tion level, etc. If the program involves support ser- 
vices, the function and technology of the client sub 
organization will be important. 


6 Always include dollar cost as one criterion so that the 


cost may be compared to the impact or effect of the 
program. 


EVALUATION CRITERIA 


Once the program purpose and goals and objectives 
have been identified the evaluative criteria can be estab- 
lished. This is often not a simple task, for measuring 
instruments and methods constitute one of the most 
difficult areas for evaluation studies. Government prog- 
rams seek to maintain and increase the well-being of 
certain segments of the total population. If all programs 
were perfectly designed and carried out, and the cir- 
cumstances giving rise to the programs never changed, 
then program inputs would be a good surrogate meas- 
ure for increased well-being. Of course these conditions 


never occur in real life and so program inputs are often 
not adequate measures. 


The next level of measures for program evaluation is 
operational outputs. For a recreation program with the 
goal of increasing the skills and hence enjoyment of 


children participating in certain sports, this might be the 
number of sports skills clinics held for children during 
the year. Again, this is not a strong surrogate to measure 
change in well-being, but at least it may show efficiency 
of operations. 


A third level of measurement is program outputs. In the 
recreation example, a program output measure would 
be the number of children attending the clinic. This type 
of measure may be the best available if no direct meas- 
ure of program effectiveness can be made. 


The highest level of measurement, and the closest ap- 
proximation of change in well-being, focuses on prog- 
ram effects. In this case it would be a measure of the 
increase in the participants’ skills and the increase in 
their enjoyment in playing the particular sports, follow- 
ing exposure to the program. Deciding on, and obtain- 
ing data for evaluation criteria that will give an accurate 
indication of a program’s effectiveness, is a difficult and 
sometimes time consuming and costly process. 


The Urban Institute in Washington, D.c. has done a 
great deal of work in this area and has devised effective- 
ness measures in a number of local government service 
areas. The following represents the Urban Institute’s 
sample goal for a local government transportation 
program, and the suggested basis for evaluation. These 
are given as illustrations of ‘people oriented’ evaluation 
criteria.” 


Program goal 


To provide access to community services, facilities 
and employment in a safe, quick, comfortable and 
convenient manner for all segments of the commun- 
ity without causing major harmful side effects. 


Evaluation criteria 
Accessibility and convenience 


Percent of residents not within ‘X’ distance of 
public transit service and more than one hour 
from key destinations. 


Citizen perception of travel convenience. 


Travel time 


Time required to travel between key origin and 
destination points. 


Congestion — duration and severity of delay. 
Road surface quality (‘bumpiness’) index. 
Citizen perception of travel comfort. 

Safety 


Rate of transportation-related deaths, injuries, 
and incidents of property damage. 


Number of transportation crime incidents. 
Minimum cost to users 

Cost per trip. 
Maintenance of environmental quality 


Noise level along transportation corridors and 
number of persons at risk. 


Air pollution attributable to transportation 
sources and number of persons at risk. 


Citizen perception of adequacy of transportation 
services. 


Monetary costs 


Program costs.® 


In practice, it would appear necessary to operationally 
define certain elements of the program. For example, 
what does quick access mean, or safe, or comfortable, 
or convenient. With these defined, objectives can be set 
to improve each of them and the program achievements 
can be determined in reference to some concrete 
criteria. Citizen input would be meaningful and relev- 
ant to both the operational goals and defined objectives 
of the program and would indicate whether the objec- 
tives were satisfactory as well as whether they were 
being achieved. The feedback from the client popula- 
tion will not indicate the level of service of the program 
relative to programs in other locations, however, be- 
cause people will adapt to the level of service and will 
only react to changes in that service. 


In most programs, absolute measurement criteria will 
not be available, e.g. What is an ideal police service or 
ideal crime solution level? Therefore relative measure- 
ments will be necessary, generally based on changes 
over time. 


Another question involves the degree to which various 
measurement criteria indicate the success ofa program. 
Which should be weighted most heavily and how might 
they be combined? Without some evidence of client 
priorities, output data have limited meaning. 


EVALUATION DESIGN 


Once program goals and objectives have been deter- 
mined and some evaluation criteria selected, some way 
is needed to determine whether the changes which are 
identified can be attributed to the program under con- 
sideration. Ideally, the evaluators would like to know 
what would have happened had there been no program, 
assuming that the world had remained the same in all 
other respects, and compare that to what actually hap- 
pened. Because this is virtually impossible, a number of 
procedures of different degrees of sophistication and 
reliability have been designed to approximate it. 


A great deal of research has been done in the area of 
evaluation design.® For these purposes, five possible 
experimental designs will be briefly examined.!® 


1 Before and after program comparison. 


This is the most common but perhaps the least reliable 
evaluation design. Using one group only, this design 
requires a measurement of evaluation criteria values 
before the program is implemented and another one 
some time after its introduction or when it is termi- 


SOL Ie 

8 Further examples of program evaluation goals and objectives are 
given in Appendix 1. 

9 The interested reader is referred to a classic work on this topic by 
Donald T. Campbell and Julian C. Stanely entitled Experimental 
and Quasi-Experimental Designs for Research, Chicago: Rand 
McNally and Company, 1966. 

10 The following information is based primarily on Chapter 111 of 
108, and on 12. 
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nated. This method is inexpensive and does provide a 
base line measure for comparison but makes no effort to 
separate out program effects from non-program effects 
so that there are a number of possible sources of error. 
The ‘before’ measure itself may be a stimulus to change, 
change may occur spontaneously, or changes shown in 
the ‘after’ measurement may be due to instrument un- 
realiability. Thus this design should be used only if 
personnel and fiscal constraints preclude the use of a 
more sophisticated design. 


2 Comparison of planned versus actual performance. 


This is another simple, straightforward and inexpensive 
approach. It compares actual post-program data with 
targets or estimates set before and/or during the prog- 
ram. This design, requires that the government set goals 
and objectives in terms of effectiveness and efficiency. 
Like #1, it does not provide for separating out program 
effects from non-program effects. When any design 1s 
used, but especially these first two, evaluators must 
make a determined search for other likely explanations 
for what has occurred. 


3 Time trend projection of pre-program data com- 
pared to actual post-program data. 


This design compares post-program data with projec- 
tions based on pre-program data. It is useful if data for 
previous years are available and have shown a some- 
what stable trend. This overcomes the problem inherent 
in the first design of attributing effects to the program 
that in all likelihood would have occurred in its absence. 
This design is more expensive than design #1 because 
some statistical expertise and more data collection are 
called for. 


4 Comparisons with jurisdictions or population seg- 
ments not served by the program. 


This design involves comparing evaluation criteria val- 
ues for the jurisdiction that implemented the program 
with those of a similar jurisdiction or population seg- 

ment that did not, and crediting any significantly higher 
incidence of the desired condition or behaviour to the 
program. Finding a similar population segment can be 
difficult or impossible, however, so this design may be 
impractical or may not bea completely reliable measure 
of program effects as a result of basic differences bet- 

ween the two populations. 


5 Controlled experimentation. 


This is the most reliable evaluation design but not 
necessarily the most valid. It is also the most difficult 
and the most costly. Pre-selected similar groups, some 
involved with the program (the experimental groups) 
and some not, (the control groups), are compared both 
before and after the program. Alternatively, variations 
of a program can be carried out with different groups 
and compared. This design requires a considerable 
amount of managerial and analytical skill and time to 
plan, carry out, and analyze the results. It also creates a 
number of special problems. People who know they are 
part of anexperiment are likely to act somewhat differ- 
ently than those who do not. People who volunteer for 
the program are also not likely to be representative of 
the whole clientele group. Finally, it may be politically 
impossible to provide a service to one group but not to 
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another. Also, if a long-term program is under investig- 
ation, the effect of many additional variables cannot be 
eliminated. 


Evaluators and managers must realize that even in con- 
trolled experiments one can seldom attribute changes to 
any one factor with absolute certainty. In the local 
government sector, where experiments cannot be 
rigourously controlled, certainty is even less likely. 


SOURCES OF DATA 


To be useful to the evaluator, data must be accurate, 
complete and comparable to other data. Existing re- 
cords and collection procedures may provide some of 
the data required by the chosen evaluation criteria but 
these sources are seldom sufficient for a proper program 
evaluation. Other possible sources include new types of 
records instituted because of new evaluation criteria, 
interviews with users of a service or clients of a program 
(sometimes citizens at large), professional ratings of 
social service programs, cleanliness of streets, etc., ques- 
tionnaires, personal diaries, and, perhaps most impor- 
tant ofall, personal observations. Consequently, all the 
measures discussed this far are potentially useful in 
program evaluation. 


There are many problems and factors to be taken into 
account when considering the use of these possible 
sources of data. A full discussion of the pros and cons of 
each source of data and method of collection is beyond 
the scope of this paper. However, some of the limita- 
tions of the various sources are noted below, along with 
some important caveats for evaluators. 


1 When employing first hand observation the evalu- 
ator must take care to ensure that his observations 
are representative of all aspects of the program. 


2 The evaluator must guard against receiving biased 
reports and ignoring certain perspectives. 


3 Attitude measures often turn out to do little more 
than measure the appeal of the program to particip- 
ants. Information on changes in attitudes is useful 
only if there is clear evidence that the attitudes meas- 
ured are connected in some way to the behavioural 
(or other) goals of the program. 


4 Interviews are generally more flexible and produce 
higher quality information than do pencil and paper 
questionnaires. 


5 Data collection procedures should have as little ef- 


fect as possible on the day-to-day working environ- 
ment. 


6 Evaluators sometimes are so eager to create their 
own instruments that they ignore regularly kept and 
readily available records, documents and statistics 
on the program. 


7 Managers who know that their program is being 
evaluated on the basis of information they submit 


may consciously or unconsciously slant and distort 
their input. 


8 Program records may be inaccurate, incomplete, out 
of date, or unsuitable for evaluation because record- 
ing techniques, definitions or categories have 
changed over time. 


9 Citizen surveys are time consuming and costly, re- 
quire technical resources to design the instrument, 
can provide misleading results if the sample is 
haphazardly selected or self-selected, e.g. question- 
naires that must be mailed back, and are limited by 
the respondent’s memory and willingness to answer. 
Professional ratings can also be costly and time con- 
suming. 


SELECTING ISSUES FOR 
PROGRAM EVALUATION 


Financial and personnel resources for local government 
program evaluation tend to be rather scarce so it 1s 
important to choose programs for which the evaluation 
will have the greatest political and economic impact.!! 
The probable benefits of the evaluation should exceed 
its cost and the program should be important enough 
financially to warrant evaluation. Suchman!?? lists three 
prerequisites for a worthwhile evaluation: 


1 an objective or goal that is considered desirable; 


2 aplan of deliberate intervention capable of achieving 
the goal; and 


3 a way of determining the degree of goal achievement 
attributable to the planned intervention. 


Hatry et al have gone into greater detail in suggesting 
a number of criteria for helping local government man- 
agers to select appropriate programs for evaluation. It 
may be helpful to repeat these criteria here. 


1 Can the results of an evaluation influence decisions 
regarding the program? Programs for which a deci- 
sion regarding continuation, modification, or termin- 
ation needs to be made are obvious candidates. Poor 
candidates are those for which decision-makers have 
strong preconceptions of program value or where 
there is considerable support by influential vested 
interest groups — if these circumstances make it very 
unlikely that the program would be altered regard- 
less of evaluation findings. (However, in some cases 
the program may be of such great importance to a 
community that government officials may proceed 
with an evaluation and be prepared to seek changes 
despite political risks.) 


2 Canthe evaluation be completed in time to be helpful 
to decision-makers? Evaluations which are com- 
pleted after public officials become committed to a 
decision are essentially useless. 


Can the evaluation be done? 


Are sufficient data obtainable on the important ef- 
fects of the program? Program evaluations can never 
resolve all questions, but before beginning an evalua- 
tion it should first be clear that it will be possible to 
gather meaningful data on significant aspects of the 
program. For example, long-run impacts of man- 
power training, health, or education programs may 
not appear for many years. In most cases, govern- 
ments are unable to wait this long. Nevertheless, it is 
often true that intermediate results can be made av- 
ailable and provide significant information for in- 
terim decisions. 


5 Cansufficient resources be obtained to meet the time 
schedule and technical requirements of the evalua- 
tion? 


6 Has the program been stable enough so that an 
evaluation will provide relevant information? If the 
program is constantly changing, or is about to 
change in significant ways, it is not a good candidate 
for evaluation. 


7 Isthe program significant enough to merit the evalu- 
ation effort? Programs which involve a large amount 
of government resources or those programs which 
have important benefits and possible negative con- 
sequences to the public, other things being equal, 
should be given higher evaluation priority. Thus, the 
likely cost of the evaluation should be compared to 
the possible decreased cost or improved effectiveness 
that could result. 


8 Isthe program suspected by the government of being 


marginal in its performance? If so, there may be 
opportunities for making major improvements or 
cost reductions. Relatively old programs that have 
not received an in-depth evaluation in a long time 
may fit this criterion. 


9 Isitanew program with uncertain potential benefits 


and costs? The program should be reviewed after 
operating long enough to demonstrate its effective- 
ness. This probably means a minimum of six months 
to one year of operation for most programs, though 
even these time periods are too short for evaluating 
long-term effects. New programs are often most 
open to alteration because they have not had the 
opportunity to build up a strong constituency. 
Evaluation of programs that are candidates for ex- 
pansion can be particularly valuable. Actually, new 
programs should have ‘built in’ measurement criteria 
which determine whether or not the program should 
be continued after a stated period of time. 


PROBLEMS OF EVALUATION 


Program evaluation suffers from a number of problems 
which fall into two categories, analytical problems and 
institutional or political problems. 


Many of the analytical constraints are quite technical 
and are beyond the scope of this paper. Some of the 

difficulties with evaluation design and data collection 
have already been mentioned. In general, valid, reliable 
evaluation is difficult to perform, requires personnel 

with quantitative analysis skills, and it can be costly. 

Merely securing agreement on the goals and objectives 
of a program can be difficult, particularly where the 

program has broad social aims. But if goals and objec- 

tives are not specifically stated, evaluation objectives 

also tend to be vague and subsequent studies will tend to 
be inferior. In fact, if the development of firm objectives 
is not feasible the rationale for a program should be 

questioned. 


Another problem that confronts evaluators is the selec- 


11 Examples of the application of program evaluation are given in 
Appendix 1. 

12 Suchman, Edward A. ‘Action for What? A Critique of Evaluative 
Research’, in The Organization, Management and Tactics of 
Social Research, edited by Richard O’Toole Cambridge, Mass.: 
Schenkman Publishing Company, 1970, pp. 90-99. 

3 108, pp. 110-111. 
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tion or formulation of measures. As discussed above, 
direct measures of a program’s effectiveness or progress 
toward program objectives are often not feasible, and 
substitute measures have to be used. While some meas- 
ures of program impact or value can usually be devised 
for even the ‘soft’ local government programs, evalu- 
ators have difficulties determining the true causal rela- 
tionships between inputs and outputs, particularly in 
time to be of use to decision-makers. If certain effects of 
the program fall outside the measures chosen they may 
go unnoticed. Alternatively, incomplete or imperfect 

measures may be treated as if they measured all aspects 
of the program, resulting in inaccurate evaluations. 


Further, program evaluation sometimes answers the 
wrong questions. Wholey14 advises that: 


... the evaluator must resist the temptation to search 
for answers to questions that interest him, but which 
may not be high on the list of questions the 
decision-maker wants answered. Decision-makers 
will be convinced of the worth of evaluation if evalu- 
ation meets the needs of the decision-maker and 
provides information useful to him. 


Finally, the interpretation of the data collected creates a 
problem. The evaluator must try to recognize the poten- 
tial influence of his personal values and biases on the 
data interpretation process. This is an exceptionally tall 
order. Compounding the problem is the fact that differ- 
ent people looking at the same data can come up with 
different, but equally rational and possible conclusions. 


Even if an evaluation study can surmount all of these 
analytical constraints, it must still deal effectively with 
the organizational and political environment in which it 
is carried out, if it is to be successful. Evaluation can be 
dangerous and threatening to managers and to groups 
of citizens who benefit from the program and have 
vested interests in its continuation. Thus, unless the 
evaluation is carried out on a new program or a pilot 
project that is likely to be expanded, evaluation will 
quite possibly meet with considerable resistance and a 
lack of co-operation. 


Evenif a program evaluation is successfully carried out, 
all will be for naught if the results and recommenda- 
tions are subsequently ignored — and many are. One 
reason for this is that frequently they are not writtenina 
style that can be easily read and understood. Excessive 
jargon and technical terms are used. Masses of statistics 
are presented without sufficient interpretation. Infor- 
mation is sometimes presented in a disorganized fash- 
ion and without an adequate executive summary.?5 


Even when properly understood, the effects of a prog- 
ram evaluation study can also be difficult to measure. 
While the study may not produce an immediate policy 


14 70, p. 360. 

15 A good guide for evaluators is the U.s. Department of Health, 
Education and Welfare’s, Preparing Evaluation Reports: A 
Guide for Authors, Washington, D.C.: U.s. Government Printing 
Oftice, 1970. 

16 70, pp. 361-362. 

17 The experiences of three municipalities, in applying program 
evaluation, are given in Appendix I. 


change, it may affect the thinking of decision-makers 
and its recommendations may be implemented gradu- 
ally over time. 


In a somewhat pessimistic summary of the difficulties 
encountered by the u.s. Federal Government with prog- 
ram evaluation, Wholey says:16 
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... we have all learned that evaluation is difficult, 
takes a lot of time to carry out, and can be very 
expensive. We have discovered that the information 
generated by evaluation studies is often incomplete, 
suspect, and unrelated to the problems at hand. We 
have found bureaucratic and organizational con- 
straints so formidable that today, after investment of 
significant resources and effort, not one federal 
agency has an overall evaluation system and few 
programs are able to make any use of the evaluations 
produced. On the whole, federal evaluation efforts 
have not been cost-effective in terms of impact on 
policy or program development. 


Most critics and proponents of program evaluation 
alike are more generous than Wholey and feel that while 
techniques are imperfect and other problems do exist, 
program evaluation can and does provide a reasonably 
accurate picture of what a program has achieved with 
the resources allocated to it.17 


RESPONSIBILITY FOR PROGRAM EVALUATION 


It is probably best, for obvious reasons, if the people 
responsible for a program are not also responsible for 
its evaluation. What is important, however, is that the 
program managers themselves are involved in the de- 
termination of criteria and feel that the measures chosen 
are adequate for the purpose. The co-operation 

of these managers is essential because they hold much 
of the detailed information about the program in their 
heads. Thus, it is important that these managers are 
not aliented by efficiency or evaluation experts. Pro- 
gram evaluation should be as non-threatening as 
possible, especially where it is aimed at program im- 
provement rather than at a continue/discontinue 
decision. 


Most large municipalities (100,000 or more people) can 
probably afford to establish small central staff units to 
be responsible for evaluation for all departments and 
programs. This type of arrangement seems to be most 
workable in local government as long as the people who 
staff the unit work closely with other managers. Heads 
of departments where evaluations are taking place 
should participate by helping to identify program goals 
and objectives, evaluation criteria, special problems, 
etc. Outside consultants can be used to supplement the 
internal evaluation unit and to provide training, or they 
may carry out complete evaluations. The evaluation 
unit should be management rather than financially 
oriented. It should examine management processes as 
well as inputs and outputs, and should preferably report 
to a chief administrator or senior management team. 


EVALUATING FLEXIBLE PROGRAMS 


In many cases the program changes and adapts as it 
proceeds. This is particularly true if those programs 
concerned with organizational development or man- 


agement improvement. Evaluating such programs is 
more difficult and requires: 


1 a detailed picture of the state of the organization at 
the outset (in regard to organizational processes, 
procedures, formal and informal structures, objec- 
tives, inputs and outputs); 


2 a clear description of any changes which are insti- 
tuted inthe program and the revised goals and objec- 
tives of the program; and 


3 definitive measurement of relevant ‘organizational 
state’ variables, discussed in para #1, at the time that 
changes in the program are introduced. 


By documenting ‘organizational state’ variables and 
changes in the program throughout the implementation 
period the effectiveness of the program can still be 
measured, and the relationships and outputs which 
change can be attributed to the program. 


SUMMARY 


Program evaluation is a fundamental aspect of man- 
agement which should be carried out by program man- 
agers whether or not a formal program evaluation is 
completed. For evaluation to take place, the purpose of 
the program needs to be clearly defined at the outset 
of the program, and goals and definite measureable 
objectives need to be established for the program. If this 
is done the program managers have essentially defined 
the evaluation criteria to a large extent. The very exis- 
tence of stated purposes and effectively determined 
goals and objectives should be a positive factor in prog- 
ram evaluation. 


Evaluators will need to examine the impact of the prog- 
ram on the client to determine whether or not changes 
in direction have taken place and should be sure to 
obtain meaningful client input. Clients and program 
managers may often be helpful in interpreting data and 
identifying causal factors. 


The evaluation should be able to answer three major 
questions. 


1 Is the program established as a comprehensive man- 
agement program which makes evaluation possible 
or is it likely that the evaluation itself is inaccurate? 


2 Should the program continue? 


3 What can be done to improve the program at this 
point? 


If the answer to the first question is no, then evaluation 
is not possible and the program managers should be 
aided in establishing a program which can be evaluated. 
Probably a well organized management audit or evalua- 
tion function could examine programs at the outset, 
and periodically thereafter, to ensure that the program 
has a clear definition of purpose, definite goals and 
objectives and evaluative measurement criteria. If these 
requirements are not established, the effectiveness of 
management in general can be questioned — irrespective 
of whether or not an outside evaluation takes place. 


Thus, program evaluation fits in well with the concept 
of effective management adopted by this paper. It en- 
compasses the techniques discussed so far in this paper 
and puts them in a context. It uses output measures, 
fiscal measures, individual goals and objectives. The 
primary difference between program evaluation and the 
other measures is that program evaluation does not 
focus on outputs, budgeting systems or managers as 
ends in themselves. It focuses on the effects of all of 
these activities on the client. It does not begin with a 
question of improvement of existing systems. It begins 
with the establishment of organizational purpose and 
ends with a discussion of how effectively the organiza- 
tion is fulfilling that purpose. Thus program evaluation 
requires a much broader perspective than the other 
approaches to measurement discussed this far. Not only 
is it a broader and more comprehensive approach to 
measurement but by documenting organizational pro- 
cesses, structures, inputs and outputs at the time at 
which changes occur, the program can be flexible but 
can still be subject to effective evaluation and meas- 
urement. 
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Management Process Oriented Measures 


The measures of performance discussed this far have 
been concerned in one way or another with the meas- 
urement of inputs or outputs. For the most part they 
have considered the municipal organization to be a 
system made up of sub-systems or programs. The 
evaluation of performance has concentrated on measur- 
ing the inputs to the system or the outputs from it. 


Some of the more sophisticated approaches, which have 
generally been financially oriented, e.g. PPB, have at- 
tempted to evolve measures for both inputs and outputs 
and to describe the relationship between the two in 
cost/benefit terms. These measures have aimed at de- 
termining how the cost/benefit ratio could be improved 
or at how the output of the system could be adjusted to 
meet the needs of the users more efficiently. 


The resulting measures were useful in that they stimu- 
lated thinking about systematic program evaluation 
and performance measurement. They moved away 
from unrelated measures of input and output toward 
measures of the impact of municipal activities with 
costs considered. 


Admirable as they are, however, these measures cannot 
tell the whole performance measurement story. If the 
purpose of performance measurement is to help both 
individual managers and organizations to improve their 
operations, these measures leave many questions un- 
answered. It is true that improvements in the cost/ 
benefit relationship generally reflect improvements in 
the operation as a whole, but for most managers the 
guidelines provided by input and output measures are 
too broad and leave them with insufficient direction for 
improving their own operations. 


Cost/benefit relationships are, in effect, dependent 
upon management activity and operating procedures. 
By themselves input/output measures cannot pinpoint 
those aspects of management that should be retained 
and emphasized or, on the other hand, those which need 
improvement. They can tell how well a work unit is 
operating but they cannot tell why, or how effectively, 
the manager(s) of that unit is/are contributing to that 
output. 


THE ROLE OF PROCESS MEASUREMENT 


While recognizing the contribution of input/output 

measures to management, this section emphasizes the 
importance of taking performance measurement inside 
the system and applying it to the internal workings or 
processes of management. Only then can performance 
measurement fulfill its potential, by taking into account 
the relationships between input, managerial perfor- 


mance and output, and not just the relationship bet- 
ween the costs and benefits of a program. 


An example of these relationships is as follows: when a 
city’s asphalt overlay program is completed without a 
high degree of efficiency, it may be inferred that the 
manager responsible is not doing a good job. While this 
may be the case, it isimportant to note that the relation- 
ship between managerial performance and the effective 
delivery of services is not necessarily a direct one. That 
is, a manager may be operating at a high degree of 
efficiency and effectiveness, yet due to constraints 
beyond his control — severe budget cuts, overwork, 
lack of manpower, poor weather, illness, strikes delay- 
ing delivery of materials, etc., his output may be down 
one year in spite of the most exemplary planning, 
foresight, motivation, resource allocation and co- 
ordination. 


On the other hand, the effective delivery of services may 
be achieved by a manager whose talents are being only 
partially tapped, or by a manager who is actually in- 
competent but who appears effective because of his 
effective subordinates, or because the financial, mat- 
erial and human resources at his disposal are actually 
surplus to his needs. In fact, a thorough management 
process analysis may even indicate the existence of one 
Or more unnecessary management levels. 


In addition, of course, individual managers should not 
be evaluated in isolation but should also be judged 
partly in terms of their interactions with other man- 
agers. Although each manager can be very effective and 
efficient with his own resources, achieving his objec- 
tives on time and without waste, he may have done so at 
the expense of other sections of the organization. 


Another important consideration is the time which 
managers spend assisting and developing their subordi- 
nates and co-operating with others, rather than just 
emphasizing the improvement of the output of their 
own units. A manager could limit these important roles 
and spend more time on his own operation, but by so 
doing he may not be contributing in an optimum way to 
the organization as a whole. Output and input meas- 
ures, whether or not they are in program form, do not 
recognize co-ordinative, co-operative and developmen- 
tal roles, neither do they indicate or identify problems 
with internal co-operation, co-ordination or communi- 
cation. These can be the key factors when assessing the 
performance of support functions such as Purchasing or 
Personnel. Using the road repair example, the manager 
responsible for asphalt overlay needs the full backing 
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and support of these other departments and also needs 

support from his own department’s equipment mainte- 
nance division. If he does not receive this assistance his 

program will suffer to some degree, through no fault of 
his own. 


Since most organizations expend a great deal of effort 
and money on managers, it would seem that the evalua- 
tion of managerial performance is important. This in- 
volves determining how well the manager himself is 
contributing to the health, efficiency and effectiveness 
of his unit, and of the organization as a whole, and 
ensuring that the manager himself obtains that informa- 
tion in a useful form. Any performance measurement 
system should provide individual managers with mean- 
ingful feedback on their activities. It should indicate 
where activities differ from those which were planned 
and why this difference is occurring. It should also 
indicate what processes and behaviour need to be 
changed so that the manager can use this information as 
a guide to improving his own performance. 


In order to measure the management function fully, 
different types of measures are needed as part of a 
performance measurement system. Managerial per- 
formance measures can fill in many of the gaps left by 
service delivery performance measures and they can 
complement and clarify those measures. 


As noted previously, the areas of managerial perfor- 
mance and internal procedures and processes seem to 
have been neglected in the performance measurement 
literature, and in considerations of methods of organi- 
zation and management improvement. The emphasis 
has been on an external evaluation of service per- 
formance — on measures that are directly related to the 
level and cost of product delivery to the outside envi- 
ronment. These, properly designed, can indicate how 
well a manager’s unit is performing the job assigned to 
it, but they do not explain the level of performance, nor 
do they constitute a practical input to managerial de- 
velopment and self-improvement. They can be used to 
exert pressure by upper management or by a finance 
department, but such pressure may actually create more 
problems than it solves, because such measures indicate 
an effect but do not identify a cause. 


The reasons why so little attention has been given to 
managerial performance measures in the past are not 
difficult to determine. ‘Results are what count’! and 
management processes and procedures do not have the 
same visibility as organizational outputs. Inefficiences 
in the processes of management are not as apparent as 
those pertaining directly to the output of the entire 
system, although they do contribute in a major way to 
the effectiveness of that output. 


Because they are not so visible, management processes 
are not so political. Political pressure, primarily from 
council, is a major cause of change in municipalities. 
This political pressure concentrates upon input (costs) 
to a high degree and output (services) to some degree. 


1 The list of references for this trite expression would number in the 
thousands; in fact, we probably all agree. The key question ts: 
‘How can results be improved?’ 
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As a consequence, management processes are infre- 
quently brought forward for appraisal or evaluation. 
There is an assumption that managers will solve their 
own problems if they are placed under sufficient pres- 
sure and, to some extent, that assumption Is correct. 
When jobs are threatened, people will exert more effort. 
Under stress, some economies will be realized. Such 
indiscriminate pressure, however, is costly. Unless ef- 
fective performance is recognized, good people will 
leave and the organization will suffer. Unless inefficient 
processes are identified and changed, optimal output 
improvement is not possible. Pressure to force higher 
production, and carefully applied approaches to man- 
agement improvement are quite different things. The 
first may result in some short-term gains, whereas the 
second should result in larger, long-term gains if the 
new approaches are properly applied. 


As far as performance measurement is concerned, the 
authors believe that there is a real need to develop an 
interest ina system that emphasizes the improvement of 
the internal functioning of the organization. Basically, 
what is needed is a system that concentrates on the 
needs of individual managers in their effort to develop 
an effective management process. The LGMp Team 
came into contact with a number of local government 
managers who were doing a poor job but this was not 
necessarily because they were personally ineffective. In 
many cases it was because the organizational system did 
not give them the assistance, the right procedures, the 
feedback, or the incentive to be effective managers. The 
exact nature of management process problems can only 
be understood through an internal analysis of the oper- 
ation of individual managers and of the various organi- 
zational processes. These problems cannot be identified 
through the examination of unit inputs and outputs by 
themselves. 


Analysis of internal factors means measuring the inputs 
and outputs of support units and examining the systems 
and procedures whereby managers interact (e.g. the 
planning process, the selection process, the financial 
information system, the administrative systems — 
filing, routing, routines, etc.) to ensure that they are 
contributing in an optimal way to effective manage- 
ment. Internal analysis also involves ensuring that each 
manager has a clear understanding of his respon- 
sibilities and knows what is expected of him. His leader- 
ship and decision-making, participation, and encour- 
agement of individual development are also important 
factors contributing to management effectiveness in the 
long-run and they too can be subjectively analysed. 


The LGMpP experience indicated that a great deal of 
organizational inefficiency and ineffectiveness was 
rooted in the areas just identified. Procedures need to be 
clearly outlined and process problems identified before 
output measures or ‘results’ can be meaningfully inter- 
preted or be used in anything approaching an optimal 
way in improving management. 


There seems to be no question regarding the importance 
of an analysis of these areas for managers who are 
sincerely interested in improving their own operations. 
For these managers, a system is needed which will em- 


phasize the roles which managers should perform and 
which will provide feedback on the important aspects of 
each job, including the processes and activities in- 
volved. 


In the following pages an effort will be made to first 
outline and then to discuss some of the processes and 
activities which seem to be involved in local government 
management and finally to suggest ways in which man- 
agerial effectiveness in these areas may be evaluated and 
improved. 


THE PROCESSES AND ACTIVITIES IN LOCAL 
GOVERNMENT MANAGEMENT 


If it is accepted that the purpose of performance meas- 
urement is to help managers to do a better job then it 
would seem logical that the best starting place would be 
to identify what managers do, where their problem 
areas are, and what information they need. The meas- 
urement system can then be designed to fit management 
needs as closely as possible. 


Quite often, however, this approach is not taken. The 
starting point is the development of a measurement 
system, usually highly quantitative, which is then ap- 
plied where it seems to fit. One problem with this ap- 
proach is that managers will not attempt to apply sys- 
tems of measurement which do not make sense to them 
or which do not seem to contribute to management 
improvement. Second, managers tend not to rely com- 
pletely on externally defined, quantifiable and sup- 
posedly objective data. Each manager develops a sub- 
jective personal information system which is often more 
important and meaningful to him. Applied measure- 
ment systems tend to seek out those activities which are 
amenable to quantifiable measures, whereas individu- 
als seek out those activities which they see as being 
important to themselves and to the job. 


The approach suggested here is to attempt to identify 
and categorize activities and processes that are impor- 
tant to local government managers and then to look at 
possible means of measuring the efficiency and effec- 
tiveness of those activities and processes. This means 
that the measures in some of these areas will be very 
subjective, and improvement, as a result of such meas- 
ures, will depend almost completely upon proactive 
individual managers who take the initiative to improve 
their own operations. In other areas, such as support 
services, client feedback is readily available regarding 
both output and processes, and measures are more pub- 
lic and objective. 


The management activities and processes for which 
local government managers need performance informa- 
tion for assessment and improvement, can be logically 
separated into a number of somewhat inter-related 
categories. These categories of management activity can 
be evaluated through methods which range from the 
self evaluation of personal management style, to broad 
measures of the operational efficiency ofthe whole local 
government organization. The categories include the 
following. 


1 The individual manager and his ability to influence 
both his environment and the activities within his 
area of responsibility, including his method of re- 


source allocation and his procedures for dealing with 
emergencies or crises. 


2 The formal inter-divisional, inter-departmental and 
inter-organizational processes and procedures, and 
more informal patterns of interaction. These proces- 
ses and procedures include both the support ac- 
tivities of staff departments and divisions and the 
operating processes, such as the budget, internal 
communication processes and information systems, 
which extend across a large portion of the organiza- 
tion. 


3 The processes of decision-making at the council 
level, including methods of communication with the 
public and council-administration interactions and 
relationships. 


4 The processes and procedures whereby the munici- 
pality adapts to environmental changes and acts to 
influence its environment where possible, e.g. the 
means which it uses to influence provincial planning 
decisions and legislation. 


In the following discussion of each of these areas, an 
attempt will be made to be as specific as possible regard- 
ing the variety of ways in which performance or effi- 
ciency and effectiveness may be measured or estimated. 
Some of these are purely subjective and for the private 
use of managers intent upon improving their operations, 
whereas others are appropriate for either personal or 
external performance evaluation and potential im- 
provement. 


1 The individual manager’s sphere of influence 


Each manager has the potential to influence his envi- 
ronment and to improve his own effectiveness in a 
number of ways. 


These include: 


a_ his personal organization and approach to administ- 
ration; 


b hissupervisory activities, including the leadership he 
provides, the degree to which he delegates and the 
amount of participation and involvement he encour- 
ages; 


c the information and communication systems which 
he establishes; 


d the way in which he deals with the allocation of 
scarce resources; and 


e the way in which he handles emergencies or crisis 
situations. 


While each of these is inter-related to some extent, a 
short examination of each in isolation has some merit. 


a PERSONAL ORGANIZATION AND ADMINISTRATION 


In establishing the role he is to play and the functions he 
performs, a manager can range from a relatively proac- 
tive stance to a relatively reactive stance. Asa result of 
governing legislation, past practice and the nature of the 
local government organization, the tendency in local 
government in Ontario has been to be relatively reac- 
tive. Perhaps the primary reason for this is that there are 
few apparent rewards for risk-taking or innovation. 
During the LGMP we found that surprisingly few ad- 
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ministrators took the initiative to really examine the 
purpose of their jobs and then to attempt to develop 
their procedures and roles to fulfill the appropriate 
functions. As would be expected, of course, those reac- 
tive managers also do not encourage such activities by 
subordinates and in some cases such behaviour is actu- 
ally discouraged. 


A large proportion of managers simply define their jobs 
in terms of past practices and the expression, “That’s the 
way it is in local government’ typifies their reaction to 
suggestions for potential change. Quite clearly, the de- 
velopment and encouragement of a proactive stance 
toward purpose and role clarification, the sharing and 
assignment of responsibility, and the development of an 
administrative system which is in concert with other 
administrative systems in the organization, represents 
one of the primary potentials for management im- 
provement in local government. Management is a 
highly individual activity, but effective managers are 
usually proactive managers and they encourage proac- 
tive behaviour in their subordinates. 


The proactive manager assumes the initiative for man- 
agement improvement by establishing goals and objec- 
tives, by getting the job done, by recognizing any errors 
made, and by learning from them. Managers can ensure 
that responsibility and authority are identified and 
properly located in the organization. They can ensure 
that they are using their time wisely and that they are 
delegating the appropriate authority to lower level 
managers. Most apparent management overload in 
municipalities is probably caused by the inability to 
delegate. 


Managers can ensure that internal systems, e.g. filing, 
are co-ordinated across work units. In this way internal 
co-operation is facilitated. 


There are many areas in which the manager can im- 
prove the things that he does, but the question becomes 
‘Can such outputs of effective management be meas- 
ured’? The answer is yes — perhaps not by a team of 
internal or external auditors, because they can be easily 
misled, but by each individual manager who knows 
whether or not he is clear on his responsibility and to 
what extent he is really trying to improve the informa- 
tion and communication systems and other processes. 
Not only is a manager aware of his behaviour in these 
areas but he can easily become aware of the behaviour 
of those managers or employees reporting to him and 
can offer them appropriate advice. 


Measures in this area of personal responsibility include 
the answers to the following questions. 


i Can the manager identify clear and comprehensive 
goals and objectives for his job? 


ii Can each person reporting to a manager identify 
clear and comprehensive goals and objectives for 
their jobs? 


iii Do members of the unit feel free to identify problem 
areas which they feel prevent them from achieving 
optimal effectiveness, and do they have definite 
channels to facilitate that identification process? 
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iv Are there any unresolved overlaps in responsibility 
in the unit? 


v_ Is every individual clear on his responsibilities? 


vi Does anybody in the unit feel that he has too little 
time to do an effective job? 


vii Can each person fully justify his position with con- 
crete, identifiable and necessary activities? 


viii Are communication systems, e.g. letter format and 
filing systems, common across the unit? 


ix Does every individual in the unit feel that he is 
performing those tasks which enable him to make 
an optimal contribution to the organization? 


Effective management systems are built on the accep- 
tance of appropriate responsibility at each succeeding 
level of the management hierarchy. Also required is the 
development of a personal monitoring system to ensure 
that effective management processes, such as those de- 
scribed, are in operation at one’s own level and at the 
next lower level. Overview process audits can help to 
identify weaknesses, but real management effectiveness 
depends upon the acceptance of personal responsibility 
for increasing efficiency and effectiveness at all levels in 
the organization. 


We have been talking bravely about assigning responsi- 
bility for management improvement to the individual 
manager. Of course, the organization must take some 
responsibility. If it does not reward management be- 
haviour designed to seek out methods of improving 
management, any initiatives gained will be short-lived. 
Senior management must recognize that the organiza- 
tion has a responsibility to reward initiative in return 
for managers’ acceptance of the role of organizational 
improvement. The implications of the genuine accep- 
tance of responsibility for optimizing efficiency and 
effectiveness at all managerial levels are rather startling. 
The tomp staff are aware of municipal departments 
which could probably provide a better service with half 
their present managerial staff. Auditors and consultants 
are unable to deal effectively with such cases of ineffi- 
ciency because the fault often lies with a passive non- 
acceptance of responsibility for emphasizing efficient 
and effective management at upper levels of manage- 
ment. It is the individual managers, performing their 
full managerial roles, who are capable of fully recogniz- 
ing inefficiencies and of carrying out an optimum man- 
agement improvement role. Some helpful questions 


which can act as measures in this area include the fol- 
lowing. 


i Can the manager vouch for the organizational re- 
quirement for every person reporting to him and 


does he know the functions that subordinates per- 
form? 


i1 Does each person in the unit feel that they will be 
rewarded for more effective and/or more efficient 
performance of their jobs or for contributions to 
overall efficiency and effectiveness? 


This discussion of the individual manager’s activities 
has been carried far beyond the identification of poten- 
tial output indicators of managerial effectiveness. This 
is because such measures are an oversimplification of 


the role of measurement in management. As discussed 
earlier in this paper, measurement is an integral aspect 
of management and must be designed to provide feed- 
back on all aspects of the management process. 


b SUPERVISORY AND LEADERSHIP ROLES 


A large part of effective leadership involves an under- 
standing of problem areas in one’s own zone of respon- 
sibility, and the development of methods of manage- 
ment improvement in company with subordinates who 
are affected by the problem. Personal feedback and 
control processes are important because a manager 
must know and be able to influence activities within his 
area of responsibility, without taking over the detailed 
management function from his subordinates. 


Leadership is a widely recognized role but the processes 
of leadership are hard to identify and leadership effec- 
tiveness is certainly hard to measure. Nevertheless, a 

few suggestions are offered below on how a manager 
might guage how well he has been operating in this area. 


i Figures for the manager’s unit on transfers, requests 
for transfers, dismissals, resignations, absenteeism, 
etc., can be useful in that they can be compared to 
those of other units, or to figures for his own unit 
over time. 


ii The frequency with which the manager attempts to 
find out how satisfied his employees are with their 
work situation or just how conscious he is of their 
feelings in this area. 


iii The frequency with which he carries out task 
oriented problem identification sessions with his 
immediate staff and the relative openness of those 
sessions. (This may need to be appraised by an inde- 
pendent manager or facilitator.) 


iv The degree to which employees’ jobs are structured 
according to their individual strengths and weak- 
nesses. 


v_ The degree to which his staff are clear on their 
responsibilities and have appropriate goals and ob- 
jectives. 


vi The degree to which the manager is aware of and 
able to reward productive behaviour. Does he have 
a performance appraisal scheme involving adequate 


feedback? 


The extent to which he is able to provide clear goals 
and objectives for his own role, as a reference for his 
subordinates. 
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viii The degree to which the manager attempts to iden- 
tify needs for training and remedial measures and 
the degree to which he takes action on them. 


ix The regularity and comprehensiveness of his mana- 
gerial review sessions (discussed in greater detail 
later in this section). 


All ofthese are measureable, sometimes with the help of 
an observer or adviser, and each has an influence upon 
both effectiveness and motivation. Some of these meas- 
ures are relatively qualitative and subjective but with 
the help of someone external to the unit in question, e.g. 
a personnel department staff member, they can be 
measured well enough to provide a reference. 


C THE INFORMATION AND COMMUNICATION PRO- 
CESSES WHICH THE MANAGER ESTABLISHES 


Another managerial role where systematic improve- 
ments in operation are possible and measureable is in 
the area of communication. 


One of the most important roles filled by a manager is 
that of acommunicator. Most of the manager’s time is 
spent in dealing with other people, both senior and 
junior to him. Much of his success as a manager de- 
pends on how well he can communicate with those 
people about ideas, needs, resources, priorities, perfor- 
mance and so on. The manager should, therefore, re- 
view his own performance in this area carefully, espe- 
cially because he is, in effect, the nerve centre for his unit 
of responsibility. 


Some useful indicators would be: 


i the number of times and the length of time that 
information is misdirected or lost; 


ii the length of time it takes to answer requests for 
information; 


iii the number of times that communications are re- 
turned for further clarification; 


iv the frequency with which information directly re- 
lated to a decision is received after the decision has 
been made; 


v. The number of complaints (direct and indirect) from 
subordinates regarding the manager’s monopoliz- 
ing of information; 


vi the extent to which a manager’s personal informa- 
tion system fills his needs for information; 
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vii the degree to which people within the organization 
understand the goals and objectives of the organiza- 


tion and of the people to whom they report; 


viii the extent to which a senior manager keeps his 
people informed of events, both inside and outside 
the organization, which might have some impact 
upon their motivation and ability to do the job; and 


ix the frequency with which a manager finds that he 
has not been kept informed by his subordinates of 
things which he should know, so that he can adapt 
and adjust to maintain an efficient and effective 
operation. 


Most of these indicators are subjective and are useful to 
individual managers as tools for management im- 
provement. Few of them are useful to higher level man- 
agers as evaluative devices but higher level managers 
can measure the junior manager’s ability to establish 
and accomplish objectives and to carry out an operation 
which fulfills the purpose of his job. These indicators 
also provide some guidelines for the type of activities 
which managers should be undertaking and which 
should be expected by the next highest level of man- 
agement. 


d THE ALLOCATION OF RESOURCES 


Ideally, resources should be allocated strictly on the 
basis of job needs and resource availabilities. However, 
as a protective measure, most managers have a tendency 
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to overestimate resource requirements. This tendency 
may be more pronounced if communications are poor 
and if the level of uncertainty is high. Managers should 
be able to gauge their performance in allocating re- 
sources rather accurately using the following indi- 
cators: 


i the percentage by which actual expenditures exceed 
or fall below past budget estimates; 


ii the number of times additional resources are re- 
quested and the percentage by which total spending 
exceeds original budget requests; 


the amount of idle time of both people and equip- 
ment; 


iv the degree to which equipment down time affects 
routine operations; 


v_ the extent of overtime or, the converse, participation 
in apparently filler activities; and 


vi the number of complaints received about over- 
work, rushing or inadequate service. 


Regardless of the measurement systems used, a manager 
is, toa large extent, dependent upon accurate informa- 
tion from his staff in this area. The more individuals can 
be made to feel responsible for obtaining and transmit- 
ting accurate data and for initiating their own 1m- 
provements, the better is the system of measurement 
which will emerge. The effective assignment of respon- 
sibility and delegation of authority are crucial for ensur- 
ing that resources are used properly and not banked up 
for contingencies that may not occur. The manager 
must have as clear a plan of activity as possible and must 
be able to influence people at higher levels, at his own 
level and below his own level, if he is to achieve his goals 
with optimum efficiency and effectiveness. 


e€ HANDLING EMERGENCIES OR CRISES 


An important role of managers, and one which should 
be considered carefully when reviewing performance, is 
the ability to handle unexpected disturbances. Problems 
which arise suddenly can interfere with smooth opera- 
tions and prevent a manager’s unit from attaining its 
objectives. Storms, labour problems, mechanical prob- 
lems, unexpected changes in client demands, action by 
other levels of government, citizen unrest, or the 
emergence of major economic problems are examples 
of disturbances which may require special emergency 
reaction. Disturbances such as these can create prob- 
lems with the allocation of resources. An effective man- 
ager tries to minimize these problems by ensuring that 
he has sufficient personnel and financial slack to cope 
with emergencies. This may involve the establishment 
of a pool of extra resources assigned on a total organiza- 
tional basis. 


The nature of emergencies is such that developing reli- 
able and valid measurements of managerial effective- 
ness in dealing with them is a difficult task. The severity, 


2 The term ‘unit’ is used here to represent any part of an organiza- 
tion which has a distinct responsibility, e.g. a department, a 
branch or a division. 

3 Examples of goals and objectives developed to establish new 
processes and new organizational roles are given in Appendix 1. 
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location, time of year, degree of danger to life and 
property, etc., all contribute to making emergency situa- 
tions unique. No one measure can be relied upon to give 
the manager a complete picture of the impact of the 
efforts of his or her unit in dealing with a crisis. Some 
appreciation of performance effectiveness can be 
gained, however, by seeking answers to the following 
questions. 


i How quickly was the emergency identified? 


ii Did the appropriate person accept responsibility for 
dealing with the emergency without hesitation? 


iii How long did it take before corrective action was 
taken? 


iv Was the corrective action appropriate and effective? 


v How long was it before normal services were re- 
stored? 


vi Following an emergency, how long did it take for the 
manager’s unit to resume normal functioning? 


2 Inter-unit? management processes 
and procedures 


As previously discussed, local government time and 
money are often wasted due to unclear responsibility, 
delays in approvals, failures of communication and 
general confusion concerning procedures. Probably a 
great deal of both council and administration’s time is 
spent in inefficient and often ineffective processes and 
procedures. 


A procedure can be defined as the recommended and 
agreed upon method for getting a specific job done. 
Thus, there is a procedure for zoning changes, one for 
handling correspondence in a department, one for hir- 
ing new staff and so on. However, in most local gov- 
ernments, procedures are not well defined, or are repeti- 
tive, clumsy and wasteful of time and resources. Irres- 
pective of whether a particular procedure is formalised 
or is informal, a manager should feel that the process for 
undertaking a task is efficient. It is part of a manager’s 
responsibility to look closely at procedures, consider 
how they could be improved, and initiate programs for 
change where necessary.? 


Processes — descriptions of the interactions which ac- 
tually take place, are important for several reasons. In 
many cases, higher level managers direct many diverse 
functions and need to establish ongoing procedures 
which they can monitor rather than supervise in a de- 
tailed fashion. Many organizational procedures are 
centralized, e.g. the budget, manpower selection, train- 
ing and appraisal and new project approval. The be- 
haviour of managers and the productivity of organiza- 
tional units may depend upon the efficiency and effec- 
tiveness of the procedures involved. Thus, the actual 
processes of operation in response to each of the proce- 
dures is important, and measurement of the effective- 


ness and efficiency of each of those management pro- 
cesses is necessary. 


Before a process can be analyzed, its purpose must be 
perfectly clear. The source of the Process or the way it 
has evolved should then be identified, as should the 
individuals who would be directly affected by any 


changes. The time involved, satisfaction with the pro- 
cess in meeting user department needs, degree of co- 
operation and co-ordination and impact upon other 
processes, are all measures which might be used. 


The effectiveness of many support services (those ser- 
vices supplied by one internal department to another), 
can be measured by the degree to which they assist the 
operational manager to save time, to provide a service, 
or to complete a project economically. An example 
would be the availability of financial information which 
tells a manager what he needs to know in order to 
control and effectively manage his expenditures, with 
minimum time-consuming input of information on the 
part of the manager himself and with optimum effi- 
ciency in the process.4 


Another major area of support lies within the jurisdic- 
tion of municipal personnel departments. These essen- 
tially emerged to fill roles which busy line managers 
were unable to handle effectively. Personnel depart- 
ments exist primarily to supply managers with the 
human resources they need and to advise top manage- 
ment regarding the effective utilization of those re- 
sources. Thus the managers who use the personnel ser- 
vice must be involved in the evaluation and improve- 
ment of that service. Personnel departments should not 
assume a control role in regard to numbers and qualifi- 
cations of personnel, for by assuming that role, person- 
nel departments remove an essential part of the line 
managers’ responsibility for efficient operation. Re- 
lieved of that responsibility to economize, line mana- 
gers are likely to fight for all the human resources they 
can get. Councils find it attractive to delegate a control 
role rather than a monitoring role to personnel depart- 
ments but, by so doing, they are essentially removing an 
important aspect of the line managers’ responsibility. 
The same argument holds true for financial control 
systems; attempts to control rather than to monitor and 
keep managers informed are very common. 


In almost every support service area, the managers who 
supply the service and the managers who use the service 
or product must together define the type of service or 
product that is most appropriate, usually with help and 
advice from other managers within their respective 
units. 


User satisfaction is probably the only true way to meas- 
ure the effectiveness of a product, service or support 
service. Unfortunately, formal measures of user satis- 
faction are usually lacking in local government and, in 
fact, only infrequently do users and suppliers get to- 
gether to determine the initial objectives for the service. 
As a result, support services are generally inadequate 
and poorly defined in local government. Duplication 
frequently results and some support departments or 

divisions are under-employed. 


An example of a management support process which 
can be evaluated is a personnel selection and hiring 

process which takes minimum time to reach a desired 
result in providing management with the type of human 
resources they need. The effectiveness of the process can 
be judged by balancing the relative costs ofa longer and 
more detailed hiring process, as determined by the per- 


sonnel department, against the potential benefits of that 
longer process, as determined by line managers. 


Another example of process effectiveness involves the 
measurement of the time required to formulate and 
create firm municipal plans, e.g., for a subdivision, and 
to obtain approval from council for the implementation 
of the project. Reduction in the time required to formu- 
late plans for a subdivision, and to present the plans to 
council, could be a measure of improvement for a plan- 
ner and could result in dividends from lower land costs 
to citizens.® 


Delays in municipal projects often arise directly from 
council’s reticence to approve submissions. Effective 
processes for council approval can help to minimize 
those delays. 


An effective process is probably one which: 


a requires the minimum number of reviews by council; 


outlines a process which will include all the informa- 
tion council is likely to require; 


c makes clear to council and administration the cost of 
delays in approval; 


d is as simple and straightforward as possible; 


e allows council the necessary time for deliberation; 
and 


f presents an optimum number of alternatives. 


Ascan be seen from the above examples, most measures 
or indices of management process effectiveness and effi- 
ciency are not absolute measures, but rather are in- 
volved with improvements in time, cost effectiveness, or 
resource utilization. 


The measurement of the effectiveness and efficiency of 
processes is almost necessarily relative, but managers 
can fairly easily estimate the time they are spending on 
routine tasks and thus can determine how much their 
use of time has improved after changes in procedures 
are introduced. Some real benefits from management 
improvement objectives can be realized in the areas of 
time required for decision-making and in the approp- 
riate allocation of decision-making responsibility, e.g. 
when meetings are held to make decisions when estab- 
lished processes and procedures should suffice. 


Estimates of gains from improved processes and proce- 
dures are usually rough and often only qualitative 
rather than quantitative, but such measurements are 
valuable if they direct the manager’s attention to an 
evaluation of the impact of processes and procedures 
and encourage improvement.® 


Some examples of such measures are as follows: 


a an estimate of the cost of implementing the new 
procedure compared to the cost of inefficiency, etc., 


4 Examples of specific goals and objectives for support departments 
e.g. finance are given in Appendix I. 

5 Examples of cases in which planning and engineering departments 
were able to clarify their roles of responsibility through goals and 
objectives are given in Appendix I. 

6 Examples of detailed process oriented goals and objectives are 
given in Appendix I. 
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that would have been incurred without the change; 


b the satisfaction of other people involved with the 
new procedures, (councillors, other managers, de- 
velopers, citizens, etc.); 

c the satisfaction of users, particularly of support ser- 
vices (this information can be gained informally or 
through simple questionnaires); 


d an estimate of the time a manager currently spends 
on routine tasks compared to the time he spent be- 
fore the. procedure was introduced; 


e the frequency of complaints after, as opposed to 
before, the change in procedures; 


f the time saved that formerly was consumed in meet- 
ings held to make repetitive decisions; 


g the time saved that formerly was spent in making 
joint decisions that now are made by one person; and 


h_ the decrease, resulting from the change in procedures, 
in the number of decisions that are delayed, or av- 
oided and an estimate of the consequent saving. 


Inter-unit managerial procedures and processes play an 
increasingly important role in local government man- 
agement in co-ordinating activities between divisions in 
departments and between different departments. Many 
of the problems in the area of co-ordination begin with 
managers — particularly in support service areas — 
who cannot or will not make an effort to co-ordinate 
their efforts with those of other managers. 


Measures which are useful in the area of co-ordination 
are: 


a the number of occurrences in which the service pro- 
vided by the manager’s unit is the cause of delays in 
the operation of other units; 


b the number of complaints due to overlapping re- 
sponsibilities or uncertainty about responsibility; 

c the frequency with which plans or procedures have 
to be changed after they have been initiated; 


d the frequency with which activities, or directives for 
action, are communicated to less than the total 
number of sections to be involved; or 


e the reverse, the frequency with which the communi- 
cation lines are clogged with information which is 
not used. 


Time and effectiveness costs and improvements are 
hard to tabulate in these areas, but the need for im- 
provement and potential means of improvement are 
easy to identify, and it is generally fairly easy to judge 
when an improvement has been made. 


Management improvements in many of these areas are 
not immediately reflected in monetary saving, which is 
of primary importance to council. Nevertheless, over 
the long run, improvements in management process and 
procedure effectiveness may pay greater dividends than 

any other approach to improving the economies and 

effectiveness of service delivery. 

3 Processes of decision-making at the council level 


Councils in local government perform two very distinct 
roles, each of which requires specific management pro- 
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cesses. On the one hand council is a representative 
body, which has the political responsibility of resolving 
conflict and supplying a base for co-operative en- 
deavours within the community, and on the other it 
must make the executive decisions pertaining to the 
operation of a large and diverse service industry. The 
following discussion will concentrate first on the politi- 
cal, and second, on the managerial role of council. 


COUNCIL’S POLITICAL ROLE 


To perform the political role, councillors need input 
from their constituents. They need to be attuned to the 
feelings and desires of the people they represent regard- 
ing the type of services which should be supplied, the 
amount citizens are prepared to pay for those services, 
and the desired immediate direction of the community. 
For council deliberations to be effective, an open forum 
should exist where each councillor can truly represent 
his constituents. Also, the whole political operation of 
council needs to be governed by regulations which pro- 
tect the rights of minorities. The processes involved are 
mainly those concerned with communication, open de- 
bate, determination of consensus, and reviews to ensure 
that all citizens are being treated fairly. As local gov- 
ernment has become more important the political role 
has become more significant. 


From the municipal administrator’s perspective the 
political role of council may be frustrating and may 
often seem to be contributing to inefficiency and 
perhaps even to ineffectiveness, particularly over the 
long term. In reality, of course, council, in its political 
role, must make decisions regarding the direction of 
local government efforts and allocate the appropriate 
resources. Given those directions and priorities, it is 
council’s management role to ensure that the required 


services and facilities are supplied as economically as 
possible. 


This paper is primarily concerned with the management 
role of local government in supplying services to the 
community. However, managers do need definitive 
targets, and the determination of targets for local gov- 
ernment services is a part of the political role. Thus, 
before turning to a discussion of the processes involved 
in managing the delivery of local government services, it 
seems appropriate to discuss the problems which seem 
to be involved in determining those management 
targets. 


Theoretically, representative government provides an 
institution which is capable of resolving conflict and of 
planning community growth. In fact, of course, plan- 
ning decisions cannot be made in a vacuum, clear alter- 
natives for action are needed so that people can react to 

them. The party system at the federal and provincial 

levels results in at least some degree of identification of 
alternatives in the form of platforms, which supposedly 
commit each party to act in a certain way. No such 


mechanism exists at the local level in most Canadian 
municipalities. 


Most municipalities also do not publicly identify their 
goals and objectives ina meaningful way. As a consequ- 
ence, the political basis which the municipality supplies 


for the effective performance of its management role is 
confused and incoherent. 


There is no question that the establishment of corporate 
goals and broad objectives for local government is a 
high priority requirement for the fulfillment of both the 
political and managerial responsibilities of coun- 

cil. (A number of alternatives for this corporate process 
have been discussed in some detail in an earlier 
publication.”) 


It is easy to simplify the problem of goal and objective 
determination in local government by appealing to a 
rational management perspective. What must be 
realized, however, is that municipal goals and broad 
objectives must have a political origin or local govern- 
ment cannot fulfill its purpose. 


In private corporations, goals and objectives have a 
more rational, economic management base and politi- 
cal factors only come into prominence as potential con- 
straints upon management. In the political sphere, the 
very existence of processes of public to council, and 
council to public communication, and of methods of 
determining council goals and objectives are, by them- 
selves, indications or measures of effective manage- 
ment. Public surveys can be used fairly regularly to 
obtain information on the degree to which the public is 
in agreement with council decisions and with the goals 
and broad objectives of the municipality, assuming that 
they exist. Any evidence of discrimination against a 
minority (usually taking place in the form of unequal 
treatment without appropriate reimbursement) is an 
indication that council is not playing its political role 
effectively. 


Before proceeding with an analysis of council’s man- 
agement role, there is a fundamental factor relating to 
the political role that deserves emphasis. Councillors, 
no more or less than other people, react to incentives, 
and will perform those activities and make those deci- 
sions for which they receive the greatest recognition 
and/or rewards. There is little value to be gained from 
speculating about what is ‘good’ for municipalities un- 
less councillors have some incentive to operate in the 
recommended way and have a firm idea of what effec- 
tive management means in municipalities. 


Frequently, particularly in small municipalities, a coun- 
cil position carries with it a degree of power to influence 
events in the community. Firm municipal goals and 
objectives may act as a constraining influence upon the 
exercise of such power. Thus, there is actually a nega- 
tive incentive for long-range planning. Even where the 
councillor has no desire or opportunity for personal 
gain, the development and continuous updating of 
municipal goals and objectives is hard work and pay- 
offs are relatively long-term. Councillors frequently do 
not have the management experience or sufficient un- 
derstanding of their own roles to participate effectively 
in such a process. 


Consequently, incentives for such initiatives do not 
exist locally, and it seems that both the capability and 
the responsibility for encouraging such processes lies 
with upper levels of government. Provincial govern- 
ments cannot make local decisions, as they have disco- 
vered in the past; they must assign that responsibility to 


local government. Unfortunately, local councillors need 
incentives to carry out their political and management 
roles — to get involved with processes which have the 
potential to bring about effective management. Only 
provincial governments have the constitutional power 
and authority to produce appropriate incentives. 


Some specific questions which should help to reveal 
council’s effectiveness in performing the political role, 
include the following. 


a Has the council established community goals and 
broad objectives? 


b Are administrators clear on their respective respon- 
sibilities for achieving those goals and objectives? 


c Have alternatives for providing each service been 
clearly identified and examined in every case and has 
the necessary public awareness been achieved and 
input obtained? 


d Do councillors feel that there is any incentive for 
efficient and effective management? 


e Is council able to keep accurately informed about 
public opinion on various issues? 


COUNCIL’S MANAGERIAL ROLE 


Having established the importance of council’s political 
role, this discussion will now center around the man- 
agement role of council in supplying the appropriate 
services.® Councils employ municipal administrators to 
carry out the service delivery function. As functional 
managers, however, councillors need to supply their 
administration with clear direction and policies for 
dealing with the public. They also need to provide incen- 
tives for doing the job effectively. They must examine 
administrative programs to ensure that those programs 
are meeting the high priority needs and they need evi- 
dence that their administrators are capable of operating 
in an efficient and effective manner. To be more 
specific, a number of council responsibilities can be 
identified. 


a The Selection and Development of Effective Admin- 
istrators 


Council is responsible for hiring, for assigning respon- 
sibility to, and for evaluating the effectiveness of its top 
administrators. Council is also responsible for reward- 
ing effective behaviour and for removing incompetent 
managers. Unless council initiates a process which re- 
quires that administrators have clear goals and objec- 
tives for their own jobs, and for the programs under 
their control, it has few reference points from which to 
evaluate administrative effectiveness. Of course, per- 
formance in the delivery of services can be measured in 
terms of client feedback — citizen feedback in the case 
of operational service departments, and administrative 
‘user’ feedback in the case of internal support services. 
This results-oriented approach is important, however, 


7 See The LGMP Experience — Guidelines For Organizational 
Change in Local Government (see order sheet on last page). 

8 A much more detailed discussion of council roles and both politi- 
cal and management problem areas is contained in The LGMP 
Experience: Phase II (see last page of this book for reference). 
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it does not help to evaluate whether or not the most 
appropriate service is being supplied, nor does it indi- 
cate how effectively the administrators are managing In 
terms of efficient use of resources. 


b Clarification of Administrative Role 


Councils need to clarify the corporate role that they 
wish top administrators to play, for example, do they 
wish their top administrators to act as a corporate 
management team, viewing municipal requirements for 
service on a holistic basis, submitting recommendations 
to council and reacting to council requests as a team? 
The fact that a council has clarified such roles and has 
ensured that updated procedures exist to carry them out 
is, itself, an indication of effective management. Thus a 
measure of council effectiveness is the existence of clear 
roles for administrators and of methods of evaluating 
the effectiveness of top administrators. 

c Priority Setting 

Unless councils have an adequate process for priority 
setting, it is unlikely that expenditures will be controlled 
effectively. Really effective priority setting probably re- 
quires the re-evaluation of a proportion of existing 
administrative programs each year. By looking at the 
rationale for existing programs as well as for new prog- 
rams, council’s discretionary power is increased. With 
an administration which is operating on a program 
format, and with clear ongoing goals and objectives for 
each program, council is in a much better position to 
determine whether or not funds are allocated wisely. 
Thus the existence of clear goals and objectives at every 
management level, including council, is a measure of 
organizational effectiveness, as is the existence of a clear 
definition of purpose and objectives for programs and 
the existence of definite measures of program achieve- 
ment. 


d Delegation of Authority 


Interference by councillors in administrative areas of 
responsibility is common and it undercuts the ability of 
top administrators to manage their own operations. 
Thus, councils need to assign responsibility and dele- 
gate authority for service delivery. The performance of 
administrators can be evaluated in terms of the accomp- 
lishment of stated goals and objectives. Measurement of 
the degree to which responsibility is clear and opera- 
tional goals and objectives exist, is possible through a 
management process and resource utilization audit, 
carried out by an internal audit function or by a consul- 
tant group. Council’s effectiveness in dealing with the 
administration can quite readily and accurately be 
measured by administrative responses. A measurement 
of the degree to which councillors are aware of specific 
administrative responsibilities and programs is also avy- 
ailable. 
4 The processes that aid the organization to adapt to 
environmental change 
Local governments are in the centre of a rapidly chang- 
ing world. Changes in community patterns, transporta- 
tion modes and requirements, social values, citizen 
needs, and quality of life criteria, all affect local gov- 
ernment far more than any other level of government. 


60 


Political demands and potential problems have in- 
creased dynamically. From primarily a maintenance 
function, local government is gradually becoming the 
court of main resort for citizens. Federal and provincial 
governments are too remote and they do not have the 
same impact upon quality of life as local government. 


Administrators are performing large scale and complex 
management functions and must cope with the changes 
in demand for services created as a result of both the 
on-going technology and social revolutions. Local gov- 

ernments must seek ways to acknowledge and continu- 
ously adapt to such massive changes. 


One necessity in this process is an awareness that an 
anticipative or planning role is important. This should 
extend beyond the development of forecasts and a plan. 
Local government has a most crucial need for the de- 
velopment of internal decision-making processes and 
for processes of interaction with other levels of govern- 
ment to facilitate both environmental control and adap- 
tation to environmental change. 


At the top administrative level, a team of experts, con- 
cerned with all the various aspects of the municipality’s 
growth, can aid in the adaptive process and can co- 
ordinate administrative reaction to change. When 
working closely with the elected body, which makes the 
political decisions, this group can provide a forum 
which can at least consider most questions and can 
anticipate to some degree in the light of current and past 
experience. 


Provincial-municipal liaison committees composed of 
alert and informed municipal councillors, backed by 
administrative teams, have the potential to contribute to 
a joint, adaptive approach to changing conditions. The 
best way to combat uncertainty is through a high level 
of sensitivity to the environment, and the best way to 
create the necessary awareness is through mutual dis- 
cussion between people with a high interest in and 
knowledge of the needs of the community. 


Routine educational programs for council members, 
particularly new councillors, can assist them greatly in 
playing effective roles. Councillors, particularly in 
small municipalities, may have personal reasons for 
maintaining the status quo, in such cases external re- 
wards (e.g. by the Province) may be required to encour- 
age an interest in management improvement. 


Councils need information in order to plan. That in- 
formation can come in the form of trend analysis of 
growth and service requirements, and/or in the form of 
analysis of cities with similar growth patterns. Councils 
which are making decisions without this type of infor- 
mation are necessarily performing ineffectively. An ef- 
fective organization is one which is aware of environ- 
mental change and which keeps itself sufficiently flexi- 
ble to meet changing needs. A useful measure of council 
effectiveness in this area may simply be the existence of 
a desire to be innov ative, to plan and to improve man- 


agementin an attempt to develop an effective organiza- 
tion. 


REVIEWING PROCESSES, PROCEDURES AND 
MANAGERIAL PERFORMANCE 


As the preceding discussion has indicated, there are 
many areas of management activity and practice which 
can be assessed and improved in the interests of the final 
product or service. Although they affect the final pro- 
duct, in many cases it is more meaningful to identify and 
measure these activities directly, than to measure the 
final output and then to work backwards to the cause of 
any problem. 


Although it is not a fashionable philosophy, the LGMpP 
has taken the inside-out approach and has emphasized 

individual manager improvement and improvement in 
managerial processes at all management levels.9 This 

approach has centered on the development of a goals 
and objectives system in the organization. The experi- 
ence has suggested that goals and objectives are a useful 

medium, particularly for establishing the prerequisites 
for management performance measurement. These pre- 
requisites include the establishment of co-operation and 
communication links, the identification of areas where 
mutual problem-solving, delegation and co-ordination 
are needed, and the clarification of roles and areas of 
responsibility. 


Goals and objectives are especially useful in establishing 
a basis for measuring the efficiency and effectiveness of 
areas of management in which output measures are not 
directly feasible. The financial information system, for 
instance, is difficult to evaluate on a quantitative basis. 
It can, however, be measured by the degree to which it 
fulfills its function or purpose in contributing the type 
of information managers require. Goals and objectives 
can also be helpful in providing an operational defini- 
tion of purpose, in ensuring that the system is geared to 
achieve that purpose, and in ensuring that divergencies 
are highlighted for corrective action. In fact, objectives 
carefully planned and agreed upon, sometimes with 
input from the person or people receiving the product or 
service, can themselves become a measurement tool. In 
cases where objectives are the measurement vehicle, 
measurement is based upon the idea that the effective- 
ness of the work unit is directly related to the effective- 
ness and efficiency with which those objectives are 
achieved. 


The potential for evaluation is achieved when each 
manager takes the time to determine goals and objec- 
tives for his operation and ensures that these are 
inter-related and integrated with the goals and objec- 
tives of other managers. This is most useful when the 
process is carried throughout the organization, with 
goals and objectives being developed at each manage- 
ment level. Integrated goals and objectives provide an 
ideal framework for analyzing the operation of an or- 
ganization. The very fact that inter-related goals and 
objectives exist for each manager and program indi- 
cates that some control processes are operating. 


It is important to recognize, however, that goals and 

objectives are essentially useless unless they are incor- 
porated as a part of the management process. A major 

step in that direction is the development of an on-going 
process of management reviews. 


Experiences during the LgmP have confirmed that man- 
agement processes and results should both be kept in 
the forefront so that managers are continuously con- 
cerned with management improvement. This means 

that managers should carry out on-going reviews of the 
management effectiveness of both themselves and their 
staff. In addition, however, managers need to consider 
the full scope of their own and their staffs role and 

accomplishments. This requires a periodic comprehen- 
sive review of all aspects of the management operation. 


Since an effective review, oriented toward management 
improvement, can make a fundamental contribution to 
management, a suggested review process is covered in 
detail over the next few pages. On-going and periodic 
reviews will be discussed in turn. Some guidelines for 
team processes and communication will also be discus- 


sed. 
The on-going review 


Part of a manager’s job is to monitor progress, to be 
sensitive to change, and to sense the changes, events and 
problems which are significant. He is thus constantly 
reviewing progress, checking with the people who re- 
port to him and setting and revising objectives to im- 
prove effectiveness. All these activities are part of an 
on-going review process, which contributes to the more 
formal scheduled review of all objectives, and to the 
state of integration, co-ordination and co-operation be- 
tween managers. 


The on-going review is as important as the scheduled 
review. As conditions change and unforeseen problems 
arise, objectives may have to be modified to avoid the 
expenditure of time and resources on unnecessary or 
inappropriate activities. Since these changes do not al- 
ways coincide with scheduled reviews, the on-going re- 
view process is necessary to ensure adaptation and flex- 
ibility. In addition, on-going reviews keep important 
objectives in the foreground, allowing managers to be- 
come proactive rather than reactive in dealing with 
problems which arise. 


Communication is obviously a vital aspect of the on- 
going review process: 


a to identify departures from the expected; 


b to let senior managers and others affected, know 
about such departures and their effects; and 


c to facilitate the continuous monitoring of problem 
areas or potential problem areas. 


Open communication and trust between managers at 
all levels is essential for honest identification of prob- 
lems and their causes. The on-going review process 
itself can be seen as a form of communication, vital for 
both individual development and organizational health 
and effectiveness. A review is not a weapon and care 
must be taken that it is not treated like one or else 
communication will be blocked. 


One problem often encountered is the question of how 
to modify objectives on the strength of information 


9 A description of LGMP experiments and progress with measure- 
ment in the four Project Municipalities is given in Appendix 1. 
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obtained through the on-going review process. Where 
there is good communication between senior and junior 
managers, objectives are fairly easily modified in accor- 
dance with new situations. During the scheduled review 
meeting a careful look can be taken at why the modifi- 
cations were necessary. There is, of course, the danger 
of modifying objectives too frequently so that they be- 
come meaningless and do not give direction to ac- 
tivities. This is no better than the case where managers 
do not review objectives in an on-going way and remain 
frozen into inappropriate programs until the review 
date. The answer seems to be to adopt ‘management by 
exception’, to some extent, making on-going and 
scheduled reviews complementary. Each manager will 
be guided by his trusted sources of information, the 
importance of the changes in the situation, the 
connection between his and others’ objectives, and by 
conferring with both his immediate junior and senior 
managers. Of course, to modify objectives simply in 
order to be able to point to accomplished objectives at 
the next review date, is to misunderstand and misuse the 
on-going review. 


On-going reviews should not have set formats, but 
should take place continually. This is important be- 
cause the manager’s behaviour, and the objectives 
which he sets, are not pre-determined once and for all, 
but are living things, likely to come under differing 
pressures in the everyday working world. For this 
reason, the manager needs to constantly review his own 
performance and review the relevance of his goals and 
objectives and the status of his progress in their direc- 
tion. This may involve setting new objectives and revis- 
ing old ones as required. Effective management is a 
dynamic, on-going operation — goals and objectives 
are tools to provide direction and continuity for mana- 
gers. 


The scheduled review 


In an ideal world, a scheduled review should not be 
needed for anything other than a check on pre-set dead- 
lines. The everyday work situation, however, is not 
ideal; work falls behind, perspectives are controlled by 
events, communications break down, feedback is not 
forthcoming, etc. As a consequence, the scheduled re- 
view becomes an important part of goal and objective 
setting. It should be emphasized, however, that the 
scheduled review is not intended as a substitute for a 
continuous, on-going review of goals and objectives. It 
is intended rather as an extension of such a process. 


When objectives are set, definite steps toward these 
objectives must be specified where applicable, and defi- 
nite review dates determined. Although different objec- 
tives will operate in different timeframes, a regular 
meeting between managers, to review general progress 
and specific objectives, is essential for a number of 
reasons. 


1 Scheduled reviews provide a framework for mana- 
gers to think about their jobs and future activities. 
They help to provide some perspective for gauging 
progress, dealing with problems, and allocating re- 
sources. The first task during a scheduled review is 
really a review of the purpose of programs and a 


redefinition of management roles and functions. Un- 
less managers consciously think about such issues 
they are neglected and whole programs or manage- 
ment roles may become misdirected. 


2 The usefulness of goals and objectives is based on 
their ability to provide guidelines and yardsticks for 
managers. This function is facilitated by a regularly 
scheduled meeting, enabling managers to step back 
and take stock of the situation, in company with 
superiors, subordinates and colleagues. 


3 Since objectives should usually be stated in terms ofa 
definite timeframe, regular reviews can help mana- 
gers to keep track of target dates and to schedule 
their activities more effectively. 


4 Where the on-going review is being neglected, the 
scheduled reviews can serve as a vehicle for bringing 
managers together to identify problems and to arrive 
at strategies for solving them. 


5 A regularly scheduled review also provides a means 
for following up on new ideas or strategies and for 
evaluating them. It allows for continuing identifica- 
tion of problems or problem areas and for consistent 
monitoring of how well goals and objectives are 
designed to solve those problems. 


6 A scheduled review can be seen as the completion of 
the goal and objective setting cycle, providing the 
basis for setting new targets where necessary. It also 
ensures that valuable procedures and effective man- 
agement styles are not discarded or changed, and 
that subordinates are provided with sufficient au- 
thority and resources to carry out their objectives. 


Scheduled reviews are more formalized than on-going 
reviews. They typically involve at least a one-to-one 
interview between the superior and subordinate. This 
discussion should focus on the accomplishments and 
problems of the junior manager in setting and achieving 
his goals and objectives. 


Scheduled reviews may also involve team discussions. 
Here, managers at a similar level in the organization sit 
down to discuss common goals and objectives. The 
purpose of this discussion is to improve communica- 
tions, to identify common problems, e.g. work overlaps 
or unclear responsibilities, and to find mutually accept- 


able solutions to problems concerning co-operation and 
the co-ordination of activities. 


The main purpose of both on-going and scheduled re- 
views 1s to constructively examine progress within the 
context of goals and objectives for: 


a personal development of managers, their skills and 
job satisfaction; and 


development of a strong organization, where mana- 
gers co-operate in setting targets, in achieving them 
and in solving problems. 


Thus reviews are an important part of the feedback 
system which helps managers to do a better job. 


Since the review process, as part of the goal and objec- 
tive setting cycle, is also an on-going activity, there may 
be some doubt about where it should begin. The LGMp 
Team believes that after the initial review, in which the 


senior manager provides the guidance and impetus for 
both on-going and scheduled reviews, the process 
should begin with the lowest management level. Re- 
views at higher levels are based on the practical prob- 
lems identified at lower levels. The problems which 
have been identified at lower levels may actually have 
their cause at higher levels or at least help may be 
needed from higher levels in identifying solutions. 


In addition to reviewing the goals and objectives of 
individual managers, the regular review process should 
also encompass the following activities. 


a A review of the purpose, effectiveness and priorities 
of all committees, including the committee of de- 
partment heads. 


b A review of responsibilities, programs and resource 
allocation. 


c A review of progress toward broad objectives that 
involve council decisions. 


The frequency of the review process interviews will 

depend ona number of factors, including the timeframe 
of objectives, the difficulty of introducing the process, 
and so on. Of course, the period between scheduled 

review processes must be neither too short for useful 
evaluation to take place nor so long that information is 
lost. Recommended spacing of review interviews might 


be: 


a annual review interviews, if the task is reasonably 
stable and the process of on-going reviews is well 


established; 


b semi-annual review interviews, spaced to coincide 
with budget reviews so that budget and cost objec- 
tives can be examined; or 


c quarterly review interviews, also to coincide with 
budget reviews. Quarterly reviews are recommended 
in an organization undergoing change or where the 
process is not yet well established. 


The goal and objective review process can have a con- 
siderable impact on management improvement, de- 
velopment and performance. Through improvements in 
communication, task orientation, organization, etc., 
the process can contribute significantly to organiza- 
tional improvement through better management. 


The following are some of the more specific ways in 
which the process may contribute to management. 
These include: 


1 managerial pay-off; and 
2 organizational pay-off. 
1 Managerial pay-off 
THE SENIOR MANAGER 


An effectively conducted review interview is one which 
involves both the senior and the junior manager in a 
process of problem identification and problem solving. 
The abilities of both are tapped and the senior manager 
is able to gain from the junior manager’s ideas and to 
understand the actual operation of the organization 

under his control to a greater extent. The LGMP experi- 
ence has indicated that managers who do not carry out 
regular reviews, generally lack an appreciation of the 


problems encountered by people reporting directly to 
them, and certainly do not appreciate the problems of 
the individuals two or three organizational levels lower. 


a By informally reviewing his subordinates’ career 
plans, perceived training needs, job satisfaction or 
dissatisfaction, a senior manager can get an idea of 
where his people want to go and how to help them to 
get there. Through developing this kind of under- 
standing, senior managers can help to ensure that the 
people in the organization are satisfied and working 
to full potential. 


b It gives him an opportunity to develop an under- 
standing of junior manager or employee problems, 
and the reasons why forecasts or objectives were 
inaccurate. Problems can be identified and the basic 
causes isolated through input from all managers in- 
volved. If responsibilities are not clear or goals and 
objectives are not appropriate, task oriented discus- 
sions with subordinates should make this apparent. 
The senior manager may find that he is not com- 
municating as well as he should with his subordi- 
nates. This information is vital to senior managers, 
and should be one of the main concerns during the 
review process. 


c The senior manager is able to detect areas of mana- 
gerial strength and weakness in his subordinates and 
to advise them of ways in which they might improve 
their management capability. In a frank, open, re- 
view interview he should also be able to obtain in- 
formation from his juniors about areas where they 
feel he is not providing them with direction or the 
necessary resources to do the job. Thus, the organi- 
zational benefits of developing and improving man- 
agement skills can be optimized by managers who 
are aware of the potential of the review process. 


d The senior manager should clarify the opportunities 
which exist for training, promotion, and transfer of 
his subordinates. Good managers are probably those 
who contribute a great deal to the development of 
their subordinates since this helps to maintain a 
highly mobile organization, composed of able peo- 
ple. Loss of managers to other organizations is not 
necessarily bad since it provides openings for move- 
ment from lower levels and ensures a fresh flow of 
ideas from replacements. 


e Periodic reviews provide a degree of control for the 
senior manager. Without this element of control 
most managers would be loath to delegate. With a 
mutual understanding that any serious departures 
from planned objectives will be brought to his atten- 
tion immediately, the senior manager is really taking 
fewer risks. 


THE JUNIOR MANAGER 


From the junior manager’s point of view, both regular 
and on-going reviews of goals and objectives with his 

superior have several advantages that he can exploit in 

the following ways. 


a Heisespecially asked to focus on the task he is doing 
and to identify those factors which prevent him from 
doing it most effectively. Through open discussions 
with his superior he is able to have some impact upon 
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decisions which will influence his own effectiveness. 
He is being involved as a decision-maker in areas of 
the operation which he alone knows best. 


b Preparation for the periodic review involves identifi- 
cation of what his career desires are and what train- 
ing or transfers he would like. This should be used by 
the junior manager as an opportunity to clarify his 
personal goals and to think about what he wants to 
do with his career. Junior managers with some sense 
of purpose are both happier individuals and better 
managers. 


¢ The junior manager can sharpen his skills during the 
review process by searching out problem areas and 
their causes. Where causes include unclear delinea- 
tion of responsibility, lack of sufficient authority or 
result from action of superiors or peers, he can sug- 
gest action, or initiate joint problem solving. The 
dialogue involved in this aspect of the review process 
can be instructive for junior managers and can con- 
tribute to organizational effectiveness. 


d The opportunity to explain why objectives were not 
met or why forecasts were inaccurate (either too high 
or too low), enables junior managers to clear up or 
avoid misunderstandings. He can thus use the review 
interview to explain his record, and if possible, to 
justify it. He can also take the opportunity to suggest 
better methods of measuring both his managerial 
and operational performance. 


e The periodic reviews represent an opportunity for 
the junior manager to check direction and ensure 
that he is continuing to devote his efforts to tasks 
which have optimum pay-off for the organization. If 
he is overloaded this can be identified. If he feels he is 
not being fully utilized he can ask for more or for 
different work. 


f Heisableto learn from his superior what his areas of 
strength or weakness are, and can develop ways of 
improving his own approach to management. While 
he knows that current appraisals may reflect those 
areas of weakness, he also has the opportunity to 
improve in the future. Managers who do not carry 
out reviews with their subordinates limit oppor- 
tunities for their development. Likewise, junior 
managers who seek to disguise weaknesses and dif- 
ficulties, rather than taking steps to remedy them, do 
themselves a disservice. 


2 Organizational pay-off 


A positive review process, successfully introduced, can 
assist in the identification of organizational strengths 
and weaknesses. These strengths and weaknesses may 
involve organizational structure, support services, ser- 
vices to the public, processes and procedures, training 
and development, or morale. The review provides a 
technique for problem identification. The goal and ob- 
jective setting process can then be used to set objectives 
to overcome those problems and to emphasize strengths 
within the organization. 


Few of the major organizational pay-offs from a review 
process are possible without some centralized manager- 
ial authority, either in the form ofa chief administrative 
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officer or an effectively functioning committee of de- 
partment heads. Co-ordination and co-operation are 
required for the development of better support services 
and the improvement of major organizational processes 
such as the budget or the information and communica- 
tion system. When major problems in operation are 
identified, e.g. inadequate information systems, some- 
one must have the clear responsibility and authority to 
take action. 


It cannot be stressed enough that the success of the 
review process depends entirely upon the individuals 
involved. Ifit is approached with honesty, openness and 
a desire to learn and improve, then it can be a valuable 
and rewarding experience for all concerned. For this to 
happen, anemphasis must be placed on communication 
and mutual understanding. When the process is work- 
ing well, the senior manager is not seen as a controller or 
as a medium for organizational reward or punishment. 
Rather, he is seen as a support for the junior manager; it 
is his job to understand the duties of the junior manager, 
to inspire him and to ensure that he has the necessary 
capacity to carry out these duties. 


Consequently, a review process is not an additional 
burden which is added to a manager’s work load; it is a 
process which includes the things that an effective man- 
ager should already be doing. This is because a review 
and evaluation of managerial performance is a crucial, 
fundamental and necessary aspect of effective manage- 
ment itself. 


SUMMARY 


Prior to the discussion in this section, the concept of 
performance measurement has been based on a view of 
the organization as a system or ‘black box’, with inputs 
and outputs that can be measured and inter-related. 
One of the assumptions inherent in this view is that the 
function of management is to transpose inputs into 
outputs as effectively as possible. However, much man- 
agement activity is only indirectly related to this role. 
Managers also have co-ordinative, co-operative and 
organizational and individual development roles. These 
roles are particularly important in support functions, 
for instance, that have no direct output from the organi- 
zation. Also, managers, are not always in direct control 
of the output from their units. Management is not a 
solitary activity but is often a dependent one. A close 
look at management activities suggests that the ‘black 
box’ view contributes very little that is helpful to indi- 


vidual managers who are attempting to improve their 
performance. 


Process oriented measures attempt to overcome these 
difficulties by moving inside the organization to focus 
on individual managers, the roles they perform, the 
responsibilities they fulfill and the processes and proce- 
dures that they establish to help them carry out those 
responsibilities. Moving inside the organization makes 
performance measurement more meaningful and help- 
ful to individual managers, however, in doing so it also 
changes the basic performance measurement charac- 
teristics. The ‘black box’ view allows the organization 
to be seen as a closed production system. Inputs and 
outputs can be defined as entities and related. The effect 


of a program or the cost of garbage collection can be 
determined objectively, in the sense that the resources 
can be divorced from the organization itself. The meas- 
urement of management activity and procedures, how- 
ever, cannot effectively be divorced from the organiza- 
tion, because in this case the measurement is the activ- 
ity. The measurement itself becomes an integral part of 
management — the process of on-going organizational 
and individual improvement. 


For discussion in this section, local government man- 
agement has been divided into different activity levels; 
the individual manager, with his divergent activities, 
roles and responsibilities; inter-unit activities; and ac- 
tivities at the council and organizational levels. Ac- 
tivities at these different levels are crucial but are not so 
easily measured in the objective sense. An approach 
considered useful was the emphasis of goals and objec- 
tives in the management process. The principal benefit 
of a goals and objectives approach is that it clarifies and 
changes the management process itself rather than 
merely reporting on the effects of undefined manage- 
ment activities. 


The LGMP Team firmly believe that goal and objective 
setting is extremely valuable as a technique: 


1 toimprove communication and co-ordination and to 
develop an integrated sense of direction; 


2 to obtain optimum input from all organizational 
members and to provide a means for recognition of 
that input; 

3 toidentify needs for change and improvement and to 
formalize a process of change; and 


4 toassist in the personal and managerial development 
and growth of all members of the organization. 


To provide continuity to the measurement process and 
to evaluate performance and identify problems in the 
achievement of objectives, it is necessary that goals and 
objectives be reviewed periodically. This review process 
should be motivational, informative and educational 
for the managers involved. It should also contribute to 
overall organizational effectiveness. 


The review process has been discussed in this section 
because it is an integral part of the goal and objective 
cycle and is basically a tool for management develop- 
ment and improvement. It is an integrated system of 
evaluation for all elements of the organization. One of 
the principal benefits of the review process is that it 
places the prime responsibility for that evaluation on 
the individual managers within the organization. As an 
approach to performance measurement it should help 
capable managers to do a better job. 
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An Overview of Performance Measurement from the LGMP Experience 


Several different approaches to performance measure- 
ment have been discussed in this paper including input, 
output, fiscal and internal process oriented measures, 
and methods of program evaluation. Taken out of con- 
text none of these methods are more correct or more 
appropriate than the others. All are useful and com- 

plementary to an effective management process. 


The appropriateness and value of each approach will 
depend upon both the management level involved and 
the purpose of the measurement. Senior level managers 
need information about the functioning of the organiza- 
tion as a whole and about environmental changes and 
reactions, to enable them to establish an effective 
strategic planning process and to implement the resul- 
tant plans. Their requirements for feedback and infor- 
mation are different than those of the manager who 
implements those plans through the development of 
tactics and who executes the necessary activities. Each 
management level will also have different measurement 
needs at different times. Consequently, the most useful 
measures will depend upon the need, the management 
level, and the situation. 


The type of measurement and the need for feedback 
may differ but the feedback system, which provides the 
necessary measures, should be totally integrated and 
interdependent with other management systems and 
with management as a whole. For example, output 
measures, in isolation, are usually almost meaningless, 
they must be related to some standard or other refer- 
ence. Objectives to meet certain targets or certain stan- 
dards, be they time, quantity, quality or improved pro- 
cesses, must be derived from higher level objectives or 
strategic plans if they are to contribute to the achieve- 
ment of organizational purpose ina meaningful way. In 
an integrated system each type of measure feeds into 
and supports other measures, which meet the needs of 
the various managers in the management hierarchy. 
Management objectives also perform an integrative role 
for those sections and departments which work to- 
gether and rely on each other. Performance measure- 
ment does not achieve its potential if it is used merely to 
estimate the relationship between inputs and outputs. It 
needs to be regarded and used as an integral part of the 
management system of an organization. Measurement 
is a tool whereby managers at all levels in an organiza- 
tion can obtain feedback regarding the effectiveness and 
efficiency of their own operations and their relation- 
ships with other aspects of the organization. That feed- 
back can then be used for management improvement. 


A discussion of the relationship between performance 


measurement and the process of management was in- 
troduced in Part 1, in the form of a management 
framework. This framework will be used as a point of 
departure to discuss the role of the various measures 
outlined in this paper. 


PERFORMANCE MEASUREMENT AND EFFEC- 
TIVE MANAGEMENT 


The relationship of performance measurement to effec- 
tive management will be discussed relative to the vari- 
ous components of the management framework de- 
scribed in Part II. 


1 Clear definition and understanding of purpose by the 
relevant managers. 


Unless the purposes and functions of an organization, 
and each of its sub-elements, are clearly defined, a 
measurement of the effectiveness of that organization is 
not feasible. Without a clearly defined purpose and 
function, the role of the local government organization 
as a whole or of any part of that organization, cannot 
be established. If the role is not established the various 
responsibilities cannot be determined and allocated. 


Basic as this requirement is to effective management, 
the LGMP experience has indicated that many individu- 
als, if not most, at the elected and top administrative 
levels of government, have seldom, if ever, really 
thought about the functions which local government 
performs. Without that fundamental orientation, input 
and output measures are of little practical use, yet this is 
precisely the case when measurement is introduced to 
many local governments in their current state of sophis- 
tication. 


Quite often, it seems that a complete reorientation of 
thinking is necessary. An example of such a reorienta- 
tion occurred within a planning department with which 
the Project Team worked.! At initial contact this de- 
partment was obviously not as effective as it might have 
been, the employees were unhappy, the department 
seemed to have no real impact on the municipality, it 
had no clear sense of direction, and the departmental 
orientation was reactive rather than proactive in respect 
to its basic planning function. After some thoughtful 
discussion these problems were recognized by the senior 
management. They agreed that the first priority was to 
define the purpose and role of the department — to 
establish its reason for existence. Once this was estab- 


1 Example goals and objectives from this department are included 


in Appendix 1 in the section on process oriented measures. 
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lished, the department could be re-organized and the 
work flows modified to ensure that the role was per- 
formed effectively. 


Top managers in the department quickly agreed that the 
department could make a real contribution to the 
municipality and the roles they defined greatly ex- 
panded the influence of the department. These new 
roles provided a strong sense of direction and the neces- 
sary context for the changes that were needed if the 
department was to operate effectively in its expanded 
role. In this case, a change of perspective from a reactive 
to a proactive stance was needed before the role and 
purpose could be effectively defined. 


Clearly, role and purpose definition is required as the 
first step in the management improvement process. 
Measurement of departmental inputs and outputs, if 
taken as the first step, will not, in cases such as the one 
mentioned, contribute to effective departmental man- 
agement. Often, it seems that when managers recognize 
departmental inefficiency or ineffectiveness they search 
for an ‘objective’ system to measure the output of the 
department. In the planning example, objective meas- 
urements of a misdefined function would have contri- 
buted very little to management improvement. Atten- 
tion would have been focused on those objective meas- 
ures and the operators who work closely with the out- 
put. Corrections would merely have resulted in more 
efficient performance of the wrong role; the real prob- 
lem lay with upper management not providing leader- 
ship or appropriate direction for managers within the 
department. Such problems will obviously not be iden- 
tified by a process centred on output measurement. Ina 
number of examples given in Appendix I, the problems 
clearly lay with upper management. However, in many 
cases, the reaction was to precisely define and attempt 
to control the activities of people at the operational 
level. These activities become the focus of improve- 
ment, refinements are made and savings are achieved, 
without identifying the real cause of the ineffectiveness, 
and without the consequent re-assignment of responsi- 
bility to carry out the necessary functions. 


Each manager needs to ensure that the purpose of his 
part of the organization, as well as the role of every 
person in contributing to that purpose, is clearly de- 
fined. Measures can then be established to provide in- 
formation to these managers telling them how effec- 
tively the outputs (products or services) of their units 
are achieving that purpose, and how efficiently and 
effectively resources are being used in the process. With 
no clear direction or goals, measures have no references 
except other measures, and these may or may not be 
meaningful in the specific context under consideration. 


2 The identification of first general and then of more 
specific activities. 

Once council and administrative departments are clear 
on their respective roles, purposes, and responsibilities, 
they need to define the activities which must be carried 
out to fulfill the necessary functions. These include the 
general areas toward which management efforts must 
be aimed, often called goals or key result areas, and 

specific targets or objectives in each of these areas. Once 
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specific targets are identified they can then be translated 
into programs of activities which represent the opera- 
tions of the department. If these specific targets are 
sufficiently comprehensive and represent well consi- 
dered priorities, the degree of progress toward those 
targets is an appropriate measure of effectiveness. 


Once a manager is clear what he should be accomplish- 
ing, the development of measures is relatively easy. This 
is particularly true in the case of support functions 
where feedback from user departments 1s compara- 
tively easy to obtain and will relate directly to the pur- 
pose of the support unit. Client feedback from the pub- 
lic, on the other hand, is somewhat more difficult and 
expensive to obtain; however, the amount of expensive 
and unused feedback information in most local gov- 
ernment organizations is quite astonishing. 


3 The development of appropriate structures and pro- 
cedures. 


Stipulated procedures will usually result in savings in 
time and resources for any recurrent activity. The de- 
velopment of such procedures requires input from all 
the individuals who will be affected, e.g. both the sup- 
plier and the user of a support service. The actual pro- 
cess of interaction, e.g. the way in which a central 
purchasing function operates, will always differ to some 
extent from the procedure which has been established 
for that operation, but carefully considered procedures 
are still very important. 


Formal structures and formal procedures are major 
determinants of the way in which an organization oper- 
ates, even though informal interaction and processes 
(the way it actually happens) are somewhat different. 
Thus, the section dealing with process oriented meas- 
ures 1s particularly applicable here, especially with re- 
gard to the operation of individual managers and the 
successful conduct of inter-departmental or inter- 
divisional activities. 


Fiscal measures also have a key role in this aspect of 
management. They help to tie the internal accounting 
and financial processes and procedures into an effective 
management system. If an organization is to have an 
effective management system it is necessary that the 
accounting and finance processes provide the type of 
information that will encourage and support that sys- 
tem. Unfortunately, what often happens is that the fi- 
nance department recognizes the need for more efficient 
and effective operations and takes the initiative in in- 
troducing a new budgeting system (or other financial 
management system). An effective budget system 
should serve the needs of both line managers and fi- 
nance departments; it requires input from both if it is to 
be established appropriately. Thus, while finance de- 
partments are recognizing the importance of the sys- 
tems approach and are encouraging program develop- 
ment, goal and objectives setting, etc., they are not able 
to bring about the necessary changes in an organization 


without contributions from managers from other de- 
partments. 


The key measurement activity in the area of structures 
and procedures is one which helps to determine the 
most appropriate structures and procedures for the task 


in hand. Structure, which is the organization of ac- 
tivities and interactions, really should emerge to 
faciliate processes, which are the ways in which mana- 
gers communicate, co-ordinate and co-operate, in order 
that management interactions can take place as easily 
and economically as possible. In most organizations, 
however, structure is established according to function 
without any detailed consideration of the activities and 
interactions of the people involved. When desired re- 
sults are not achieved, structure is often blamed without 
first undertaking an effective analysis of actual patterns 
of interaction and processes. As a consequence, changes 
in structure are made which are inappropriate and inef- 
fective. 


Informal structure, the actual pattern of interaction, 
often differs radically from formal structure. Where 
radical differences are apparent between formal and 
informal structure or where formal structure seems to 
hinder rather than facilitate interaction, new formal 
structures should be considered. A further LGMP publi- 
cation The LGMP Experience: Guidelines for Organti- 
zational Change in Local Government discusses some 
procedures which might be used to re-establish struc- 
ture or to improve support processes. 


4 The development of an ongoing management oper- 
ation with internal monitoring and control proce- 
dures. 


A subjective measure for each manager to consider is 
how closely his own definitions of the major priorities, 
targets and operational problems coincide with those of 
his subordinates. If there is a great deal of variation in 
areas for which subordinates have specific responsibil- 

ity, then monitoring and control processes are not serv- 

ing their functions. The role of clear goals and objec- 
tives in monitoring and control has been discussed in 
Part vi, of this paper. As long as goals and objectives 
have been fully and carefully defined, then an effective 

review process, again described in Part VI, can act as 

both a monitor and a control. 


Output measures, and other measures of efficiency and 
effectiveness, have a useful role in control. They can 

help determine to what extent the objectives have been 
met and can indicate where improvement is needed. The 
role of these types of measures is limited, however. They 
can help to indicate the accomplishment ofan objective 

but they cannot help to determine whether or not the 

objective itself is the correct one in the circumstances. 

This is an important aspect of performance measure- 
ment that is frequently overlooked. 


Efficiency and effectiveness measures must be related to 
an objective or to a predetermined level of activity. In 
turn, an objective must itself be related to the goals and 
purpose of the organization. An example was given 
earlier of a measure of police performance which in- 
volved the miles driven. Obviously, police officers 
would tend to drive as many miles as possible in a shift if 
this were a criterion. This objective was not directly 
related to the purpose of the police force and indicates 
that the achievement of an objective does not necessar- 
ily mean that the organizational purpose is being ful fil- 
led. This is why it is important to see performance 


measurement as a part of the overall management pro- 
cess and not to simply measure products or results. 


Every manager is responsible for certain outputs regard- 
less of the nature of the task. The LGMP experience has 
indicated that such outputs can be clearly defined in 
conjunction with the next highest level of management 
and measured with the help of client feedback. Many 
managers are really performing an internal service or 
support role for other managers but this does not pre- 
vent the measurement of their effectiveness in that role, 
in fact it can make such measurement or feedback 
easier. 


Whenever possible, managers at all levels of an organi- 
zation should obtain feedback from clients, whether 
those clients are the public or other elected or adminis- 
trative members of the local government organization. 
In almost all cases, client feedback is the most approp- 
riate measure of effectiveness although it must be re- 
membered that clients often have little appreciation of 
the alternative services which might be provided. 


The important point is that as long as a manager has a 
clearly defined role with specific targets, the measure- 
ment of performance is relatively easy. On the other 
hand, if a manager is unable to explicitly define both 
role and targets his ability to manage effectively must be 
severely questioned because his performance can not be 
accurately measured. 


Control of performance has seldom been defined to 
include the reward or reinforcement of adaptive and 
innovative behaviour. Yet certainly that is one of 
management’s major responsibilities and one which is 
dependent upon the climate and reward system which is 
established. Local government, in particular, has been 
an inadequate performer in this area. Innovation is 
often discouraged by the system and rewards for effec- 
tive performance are seldom apparent. Thus, managers 
should have objectives to innovate and explore alterna- 
tives. The existence of a search process is in itself an 
indication of good management, whether or not the 
search results in innovation in any given period. 


If managers consistently set goals and objectives and 
rate the relative priorities of different objectives and 
programs under their control, they are essentially carry- 
ing out the major requirement of zero based budgeting, 
but the emphasis of their efforts is upon effective man- 
agement rather than upon financial criteria. 


5 A periodic evaluative procedure to ensure that the 
organization’s purpose and goals are being achieved. 


The review process discussed in Part v1 is a special 
type of monitoring device which can have a major im- 
pact upon organizational effectiveness. 


The LGmp staff are convinced that not only should 

managers initiate team and individual reviews of objec- 
tives, processes and outputs, but that higher levels of 
management should also set aside a designated period 
in which to re-examine their own purposes, roles and 
the broad goals of the organization. The LGMp Team 
questions the ability of any council to effectively man- 
age a municipality, if it does not take the time and the 
trouble to periodically sit down as a body and examine 
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its own role, and the role of individual councillors in 
that management process. By the same token, the cor- 
porate contribution of top administrators who never sit 
down together and discuss the broader issues in the 
community and the role of local government in provid- 
ing a desirable quality of life, can also be questioned. 
These are the planning and monitoring functions of 
corporate management; they involve an evaluation of 
the past, a prognosis of the future and the formulation 
of some plans which will facilitate some control of the 
municipality’s fate. It is these plans which ensure that 
the administrative objectives are up to date and that the 
measurement systems are meaningful. 


Reward systems were discussed under #4 above. Un- 
fortunately, there are few apparent rewards for the 
councillors in municipalities who plan and manage ef- 
fectively. In fact, careful planning and establishing di- 
rection may reduce a councillors political and personal 
power in a community. It is in this planning area that 
the Province can contribute incentives and guidance to 
the municipal process. Incentives can take the form of 
carefully considered responses to municipal initiatives 
in planning, at least, with the development of some type 
of reward system for municipalities which have intro- 
duced an effective planning and review process and 
which have clear goals and objectives at the corporate 
level. The formulation of future oriented goals and 
objectives by an essentially political body (council), 
which is better equipped to handle the resolution of 
current conflicts, is a difficult role. This aspect is further 
discussed in some detail in The LGMP Experience: 
Phase II. Councils require incentives to become in- 
volved in such a process and require administrative and 
probably some consultant help to carry it out success- 
fully. Provincial advisors could play an important role 
in this area by supplying consistent advice over a long 
period of time. 


6 Both ongoing and periodic modification and re- 
establishment of goals and objectives. 


Management reviews not only have the function of 
examining past performance but also should involve 
both ongoing and periodic re-establishment of goals 
and objectives. Objectives are essentially useless unless 
the appropriate managers use them as reference points 
for management, thus progress must be reviewed on an 
ongoing basis. Comprehensive periodic reviews also 
perform a function by allowing managers to re-evaluate 
the effectiveness of their own activities. 


Tying performance measurement into the management 
process acknowledges the importance and valuable role 
that it can play in an organization. As has been seen, 
there are many different methods of measurement, 
which may or may not be appropriate. 


PERFORMANCE MEASUREMENT FROM THE 
LGMP PERSPECTIVE 

The interdependence and integration of management 
and performance measurement was recognized by the 


2 Specific accomplishments of the LGMP in areas related to meas- 


urement and some of the problems encountered in each of the 
Project Municipalities are outlined in Appendix 1. 
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LGMP Team. In fact, one of the major strengths of the 
LGMP lay in its emphasis upon the total management 
process. Managers were aided in clearly establishing the 
purpose of their operation and the roles they needed to 
play to achieve that purpose. While formal measure- 
ment was not emphasized it was made clear that objec- 
tives had to be measurable and that each manager and 
each program should have definitive objectives. The 
participation of all people in the organization in iden- 
tifying problem areas and in examining solutions re- 
ceived major emphasis.? 


The LGMP Team found that it was sometimes difficult to 


inspire managers to develop and improve their man- 


agement abilities. One of the problems was that munic- 
ipal managers are only infrequently trained in manage- 
ment. Many managers in local government are techni- 
cal specialists who have become managers through ad- 
vancing in their field of technical expertise (such as 
accounting, engineering, planning, etc.). They are well 
qualified to evaluate the service-related performance of 
their employees on the basis of their special training, 
experience, and so on. They are, however, generally 
unfamiliar with delegation, administration and the 
evaluation and review of managerial performance, and 
often need help in this area. The LGMpP emphasized the 
development of management systems, both at the or- 
ganizational and the individual level, in the hope that 
this would help managers to develop their own systema- 
tic approaches to measurement and to management 
improvement. 


During the LGMP experience it became apparent that 
many managers were operating effectively within nar- 
row confines but that they had never taken the time or 
the trouble to define their roles and tasks in a broad 
sense and to gain a perspective on how they might 
contribute to the organization as a whole. Thus, com- 
petition for resources, overlaps of responsibility and 
ineffectively defined support services were common 
problems. A large proportion of the LGMP effort was 
devoted to encouraging managers to take broader pers- 
pectives. 


Probably, no other organization has experienced pro- 
blems in the area of definition of responsibilities and 
assumption of authority, to the same degree as those 
experienced by local government. Municipalities hide 
behind the constraints of the Municipal Act and point 
to examples of Provincial intervention in cases where 
they have attempted to take the initiative. Yet no 
municipalities in Canada, to our knowledge, have a 
clear and explicit set of corporate goals and broad 
objectives which would warrant, or even permit, a large 
degree of delegation of authority and assignment of 
responsibility by the Provincial government. 


A further problem was that many managers seemed to 
be unable to specify either their organizational or man- 
agerial roles, or to set priorities and goals and objectives 
for the future. In some cases, before goals and objectives 
could be set, managers needed basic instruction in the 
concepts of management — delegation, supervision, 
etc. In other cases, rather than setting out by establish- 
ing goals and objectives, the Team found it to be more 
advantageous to hold meetings with managers to iden- 


tify specific problem areas. Objectives, with stated time 
and quantity targets, could then be set to overcome 
these problems. 


Another difficulty in local government was the lack of 
interest (sometimes unspoken) in using measurement 
systems of any kind. Perhaps, partially as a result of 
insecurity, managers were reticient to measure perfor- 
mance in case that measurement was used as a tool 
against them. Associated with that insecurity was a 
tradition of reactive management, which seems to be 
almost universal in local government administration. 


Externally imposed evaluative systems would have been 
of little help to most of these managers. It would have 
been futile to have superimposed an output, program 
oriented measurement system on a department that was 
not geared to think in terms of measurement, that was 
wary of any type of measurement system, and that was 
not secure about its role and responsibilities. There is 
little incentive for improvement in such a system and 
people will quickly find a way to fudge the data if 
necessary. Situations such as this convinced the Project 
Team of the importance of the development of better 
internal management systems if management in local 
government is to be improved. 


It was assumed that performance measurement would 
be used to help individual managers to manage their 
activities rather than to provide a control function for 
top management. Management systems established sol- 
ely for control purposes defy all the theories of human 
motivation. Effective managers are not helped by hav- 
ing somebody peer over their shoulders to check per- 
formance. They are helped by having the information 
that will assist them to understand and profit from the 
changes that they see happening around them. Effective 
managers seek to grow and develop and to find better 
ways to express themselves in their management 
capacities. ‘Improved’ management systems, that the 
manager did not help to create, that do not measure 
those aspects that he considers to be important, and that 
do not help him sort out and achieve his goals and 
objectives, are subject to abuse. 


In a number of cases, the LGMp Team saw that the 
reaction to these systems was political maneuvering, 
game playing, the fudging of results or the proposed 
establishment of more complex systems to take the heat 
off. Rather than modifying the system to help them ina 
meaningful way, reactive managers would adjust their 
behaviour to pander to the system. Meaningful man- 
agement improvement was limited in such circums- 
tances. 


Using performance measurement to control and 
monitor managers rather than to assist them in their 
operations is one critical problem that has consistently 
underscored efforts at management improvement. The 
LGMP Team found the whole area of management 
control and responsibility to be an important one and 
worthy of special discussion. If an organization does 
not trust its managers and give them sufficient scope 
and freedom to operate, the potential for effective 
management is certainly limited. 


MANAGEMENT RESPONSIBILITY AND CON- 
TROL PROCESSES 


Almost all organizations are concerned with the de- 
velopment of some type of control system which will 
ensure that the people in the organization are carrying 
out their designated tasks. The most effective way of 
ensuring that managers are performing their tasks 
economically and efficiently is through the acceptance 
of responsibility by each manager in the system. He 
needs to accept responsibility for ensuring that persons 
reporting to him have clearly defined roles and targets 
which they understand, preferably have helped to plan, 
and have a commitment to perform. Clear targets and 
roles make possible task-oriented discussions regarding 
input, processes and outputs between superiors and 
their subordinates (and peers if there is a fair degree of 
overlap in function, or if one provides a service for 
another). The most effective control process, therefore, 
is an integral part of any effective management system, 
since it is based upon the acceptance of responsibility 
for promoting effective and efficient operation by each 
manager in the organization. 


In addition to this fundamental management-based 
control system, at least three distinct processes can also 
contribute to organization control. These are as fol- 
lows. 


1 Financial audits and the ongoing financial informa- 
tion system can provide management at all levels with 
some idea of the efficiency of the current operation and 
can provide data which compares that operation with 
past performance. Financial audits constitute a type of 
control for higher level management, but audits involv- 
ing strictly financial analysis do not indicate whether or 
not the best process is being used or even if the most 
appropriate service is being supplied. Financial infor- 
mation systems should provide managers at all levels 
with feedback on the costs of their operations. Thus, 
they are an aid to managers in identifying trouble spots 
where the operation is not going according to plan. 
Financial information should be current, understanda- 
ble and should present the manager with an overview of 
his operation which enables him to control his alloca- 
tion of resources, and to monitor areas where problems 
seem to be developing. Carefully constructed budgets 
with clearly stated objectives and relevant costs will 
provide an excellent base for a financial information 
system. 


2 Management audits, a concept which requires some 
discussion and definition, can help to identify the pro- 
cesses managers are actually using. An effective man- 
agement audit is probably one of the most useful man- 
agement control devices, but such audits have limita- 
tions which must be clearly recognized. Since the con- 
cept of management audits is relatively new and defini- 
tions abound, a review of the potential role of manage- 
ment audits and some of their limitations might be 
useful. A management audit includes: 


a an examination of the goals and objectives of an 
organization and its parts, to determine how well 
those goals and objectives are inter-related and to 
what extent they are being accomplished; 
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b an identification and analysis of the processes of 
management to determine how efficient they are in 
terms of time and resources and where new proce- 
dures, methods and approaches might be more ap- 
propriate; and 


c the obtaining of evidence regarding management 
problems within the organization so that these can 
be fed back to managers at the appropriate level, or 
ensuring that there is an ongoing problem identifica- 
tion process which is already accomplishing this 
task. 


Unfortunately, many organizations are trying to use 
management audits to determine the appropriateness of 
goals and objectives, a task which can really only be 
accomplished by the management of an organization, in 
consultation with the client or clients. On the other 
hand, the auditor can question the appropriateness of 
goals relative to the stated purpose of an organization 
and also question management as to whether there are 
sufficient clear goals and objectives to outline programs 
to the extent that their effectiveness can be evaluated. 
An auditor can also suggest that there is an urgent need 
for clearer role definition and more definitive responsi- 
bility for managers, so that their performance can be 
evaluated against some more concrete criteria. An au- 
ditor will encounter a major problem, however, if he 
attempts to redefine the goals and objectives of an or- 
ganization or if he begins to suggest action alternatives 
without the proper dialogue with management. 


3 Financial audits, management audits and perfor- 
mance reviews can combine to indicate how well mana- 
gers within the system are performing, where additional 
resources are required, where changes in processes ap- 
pear to be advisable and where training is needed. 


By identifying how a manager is performing financially 
and operationally, the above process, plus the financial 
and management information systems, provide him 
with information which he can use to improve his own 
effectiveness and efficiency. 


None of these monitoring and controlling processes will 
be particularly effective, however, unless managers ac- 
cept individual responsibility for ongoing management 
improvement. Unfortunately, the acceptance of per- 
sonal responsibility has often been discouraged because 
control processes have frequently been superimposed 
upon managers, rather than incorporated as an aid to 
fulfilling the managerial role. As has been noted, mana- 
gers in such a position may attempt to satisfy a number 
of control requirements instead of concentrating upon 
the effective and efficient production of a specified ser- 
vice. 

Where management processes such as the budget, per- 
formance appraisal, and the provision of management 
information have evolved in a control role rather than 
in a managementassistance and development role, they 
have lost the potential to contribute to more efficient 
and effective management. If full use is to be made of 
such processes to increase management effectiveness, 
managers within the organization need to be involved in 
establishing them. Budget processes determined by a 
finance department are unlikely to meet the needs of 
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operating managers and may involve large expenditures 
of time with little purpose. In the same way, perfor- 
mance appraisal processes can only fulfill management 
development roles if managers feel that they are worth- 
while. In both cases, the expert input of finance and 
personnel specialists, respectively, is necessary but the 
process must be established to meet the needs of mana- 
gers and not of staff specialists. 


Once processes have been established, managers will 
need assistance from staff specialists in learning how to 
best carry out the process. As higher level managers 
become familiar with a process they can help people 
reporting to them to use it effectively. 


PREREQUISITES FOR PERFORMANCE MEAS- 
UREMENT 


If performance measurement is accepted as being part 
of an ongoing management improvement system it can 
be seen from the foregoing discussion that certain pre- 
requisites must be established before meaningful per- 
formance measurement can take place. These are as 
follows. 


1 The purpose, role and responsibility of the manager 
or management unit to be assessed must be known 
and understood before measurement criteria are es- 
tablished or put into operation. If these are not estab- 
lished, the objectives and target measures may not 


reflect what the manager should really be trying to 
do. 


2 The necessary community co-ordination and co- 
operation channels should be open and clear. The 
measurement system should measure whether or not 
the necessary processes and procedures are working 
well. 


3 Managers must express a real interest in learning and 
in improving their management activities. This 
means that they should develop a tolerance of failure 
and accept failure as a part of development and learn 
from it. Performance measurement is not just criti- 
cism, it is a learning process. 


4 Performance measures must be developed by the 
managers who are responsible for completing the 
tasks. Feedback is the best way to gauge effective- 
ness, consequently measures can include suggestions 
from experts, from users of services or products, or 
from other members of staff. Even in the areas of 
service delivery, performance measures cannot be 
developed by consultants, advisors or even senior 
managers. However able those people are, they are 
only partially familiar with the task that is being 
done, they have little or no influence or control over 
how it is being done, and do not bear the direct 
responsibility for its successful accomplishment. 
Senior managers are, of course, indirectly responsi- 
ble and will estimate how well the manager is per- 


forming relative to others and give him feedback on 
this. 


5 The management system in operation should prom- 
ote the use of measurement, and reward managers 
tor developing appropriate measures. Effective 


measurement will depend upon frank and honest 
input from peers, staff and superiors. 


6 Top managers and top management teams must be 
willing to evaluate themselves and not just use effi- 
ciency and output measures to evaluate lower level 
managers. 


SUMMARY 


Performance measurement is not the answer to all the 
problems of municipalities. Experience has shown, 
however, that when properly implemented, such sys- 
tems can go a long way toward helping administrators 
identify their problems. Systems of goals, objectives and 
performance measures that have been implemented to 
date have greatly enhanced the administrator’s ability 
to identify problems and to allocate funds in an optimal 
way. These are abilities that all city administrators 
need, in order to meet the increasing demands for ser- 
vices, while at the same time operating within tight fiscal 
constraints. 


Certain trends in performance measurement in muni- 
cipalities are easily discernable. First, there is the rapidly 
growing interest in this field. Hopefully this will mean 
that many more municipalities will implement perfor- 
mance measurement systems in the next few years. Sec- 
ond, the trend in performance measurement is towards 
sophistication and away from simple workload meas- 
ures. Hopefully, this will mean more involvement by the 
public and by individual managers in the running of 
local government. The demand for more and better 
municipal services is becoming stronger in Canada, 
while the financial resource base for municipalities is 
not growing in a similar manner. Comprehensive per- 
formance measurement contributing to improved per- 
formance is one way to help meet these challenges. It 
seems, however, that Canadian municipalities are lag- 
ging behind those of the United States and the United 
Kingdom in this field, in both interest and implementa- 
tion; this is something that they canill-afford to do. Our 
conclusions regarding the potential contribution of per- 


formance measurement are remarkably simple. Simple 
as they are, however, and inter-related as they are with 
basic management, we have yet to find an organization 
applying this systematic approach in a comprehensive 
way. 


The authors of this paper are convinced that the fault 
does not lie with middle managers. They believe, as a 
result of their experiences with at least eight local gov- 
ernment organizations during the course of the LGMpP, 
that managers wish to do a good job and that personal 
awareness ofa potenti] for management improvement 
is a most powerful incentive to change. Given the tools, 
most managers will evaluate their work and will try to 
improve their own effectiveness. 


It is a senior management responsibility to ensure that 
these tools are available. The key for upper level mana- 
gers is to ensure that the organizational purpose and 
role are clearly defined and communicated, and to en- 
courage managers in the system to identify goals and 
objectives and to review them on a regular basis. Meas- 
ures of input, measures of output and measures of the 
efficiency of processes can all contribute to the evalua- 
tion of overall management efficiency and effectiveness. 
Even the fact that such processes exist is, in itself, a 
major measure of management effectiveness. 


Finally, this paper should add a new dimension to 
municipal performance measurement thinking in two 
respects. 


1 It presents a broadened perspective of performance 
measurement that relates it directly to a framework 
of effective management. 


2 It suggests the incorporation of a systematic ap- 
proach which will allow managers at all levels of 
authority to evaluate and review the performance of 
their own activities, and which will give them some 
idea of what they personally can do to improve their 
own operations and the effectiveness of the organiza- 
tion. 


rR) 


Appendix | 


Examples of Current Performance Measurement Practice 


This appendix provides examples of measures and ap- 
plications of performance measurement. In the interest 
of clarity the main part of this paper has not been 
interrupted with lengthy examples of the various meas- 
ures being discussed. To clarify and differentiate the 
concepts involved, however, it is important to have this 
back-up material. Examples are included of each of the 
types of measurement that were discussed in the main 
body of this paper. These examples are not proposed as 
being ideal; they have been chosen on the basis of the 
clarity with which they express the underlying concept. 


Each municipality needs to develop measures which ‘fit’ 
the particular needs of its own managers. Conse- 
quently, these examples should not be considered to be 
models which can be successfully transferred into a 
different context. As we have tried to indicate, mana- 
gers themselves must accept responsibility for develop- 
ing measures that are meaningful to them and to other 
managers in the system who need such information. 


Service Function! 
Solid Waste Collection 
b Liquid Waste Treatment (Sewage) 


c Law Enforcement (Police) 


d Law Enforcement (Courts) 
e Health and Hospital 


f Recreation 


g Street Maintenance 


h_ Fire Control 


i Primary and Secondary Education 


Each of the different types of measurement will be 
discussed in turn. 


A Output Oriented Measures 
B Fiscally Oriented Measures 
C Program Oriented Measures 


D Management Process Oriented Measures 


A OUTPUT ORIENTED MEASURES 

Output oriented measures can be broken down into: 
1 throughput; 

2 efficiency; and 


3 effectiveness. 


1 Throughput 


The following measures provided by the Urban Institute 
are good examples of throughput or workload meas- 
ures which can be applied to various municipal services. 


Illustrative ‘Workload’ Measure 


Tons of solid waste collected 


Gallons of sewage treated 


No. 
No. 
No. 


No. 
No. 


of surveillance-hours 
of calls 
of crimes investigated 


of cases resolved 


of patient-days 


Acres of recreational activities 
Attendance figures 


Square yards of repairs made 


Fire calls 
Number of inspections 


Number of pupils 


196. 


As an application of these measures, the following pro- 
vides a good example of the development of a produc- 
tivity index for refuse collection workers using very 
simple measures — manhours, route completion rate, 
quality of refuse collected, etc. 


7? 


Detroit Productivity Incentive Plan for Refuse Collection Workers: Computation of Productivity Index, March 12, 1973 
to December 30, 1973, Computation Period.? 


Computation Periods 


Baie 12, 1973 July 1, 1973 October 1, 1973 
to to to 
June 30, 1973 Sept. 30, 1973 December 30, 1973 
1 Paid man-hours per refuse 
ton collected 
a Average for period 2.43 2.44 206 
b Average for same 
period of last year 3.06 3.14 3.49 
c Optimum for same 
period of last year 2.36 2.48 2.43 
d Index for period +.45 sare) 4.25 
2 Route completions 
a Average daily , 
percentage for period 67.4% 69% 83% 
b Formula standard 
percentage 90% 90% 90% 
c Index for period =,20 = 1A)) —.14 


3 Overtime hours 
a Total number this period V7 toN) 105,470 43,668 
b Average of totals 
for same period of 


three previous years 87,100 1324700 81,700 

c Index for period EZ —.04 +.09 
4 Quality factor — 

Index for period 00 00 .00 
5 Combined productivity 

index for period +.27 +.34 lO 
INCORPORATING INCENTIVES a Determine objectives, to provide criteria for delineat- 
In its efforts to improve productivity, the City of pata 
Orange, California, chose work measurement and b Develop list of true outputs for counting. 


work simplification tied to an incentive scheme.* This 


: c Determine ways of counting outputs. 
least complicated approach to measuring throughput Dee ay feat ee 
3 : 

was chosen because the measurement process was new : , i terme ed be CUS E i 
to the city and there was a lack of technical management of WOrK measurement techniques) (ona 
sophistication. e Determine base period (bench-mark) productivity. 
The process involved the identification and recording of f Develop and implement an on-going productivity 
activities within different functions. Each function was measurement and reporting system. 
broken down into those aspects that were identifiable, g Motivate managers to improve productivity by 
controllable and measureable. Measures of output were changing such factors as: 
then established for a base period so that improvement 
could be measured. ee SE 

gah a li manpower allocation; 
The following steps completed the productivity im- P Oe 
provement process. m1 work planning; 


7 = iv the detailed methods of producing outputs; and 
93; 


F 
3 See Performance Measurement Programs, City of Orange, 
California, Appendix u. 
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Vv introduction of quantification of planned out- 
puts, productivity standards, and forecasts of 
productivity into the budget. 


Thus, this approach concentrated on changing work 

patterns to effect measureable changes in outputs. The 
organization for the program included the establish- 

ment of a part-time productivity team to conduct work 
simplification studies on a city-wide basis. 


The program was extended to include an incentive plan 
in which salaries were related to output measures. In 
this case Police Department salaries were tied to de- 
creases in the crime rate. Reductions in the crime rate 
for rape, all burglaries and auto theft were directly 
related to increases in pay. For instance, if the rate for 
the above crimes fell by 3% over a set period, then 
salaries would be increased by 1%. The output measure 
in this case was the number of radio call slips which 
resulted in reported offenses. 


After two years of operation this incentive plan was 
dropped. In explaining why the scheme was not pur- 
sued, J.J. Carmichael, Administrative Analyst for Man- 
agement Sciences for the city, made the following ob- 
servations in a letter to the Project Team. 


All of the reasons for its demise are not clear; how- 
ever, here are my own opinions: 


a It is difficult to establish the degree of influence 
that police actions have on the prevention of crime 
or to ascertain the weights attributable to other 
factors; i.e., economic climate, urbanization, pov- 
erty, alienation. 


b The incentive was ‘one way’ in action. It did not 
provide for pay reductions if crime rates increased 
at 2 later Gate. 


c The incentive was locked into permanent pay in- 
creases which tended to push salary structures out 
of line. Personally, I think one-shot bonuses 
would have obviated this problem. 


d There may be undesirable ‘spill-over’ effects of 
crime increases in adjacent jurisdictions. 


e Other crime classes may be adversely affected by 
concentration on a certain group of crimes. 


If some of these objections could be overcome, there 
is reason to believe that a modified version of this 
incentive scheme could be successful in small or 
medium-sized cities. 


2 Efficiency 


Efficiency measures are those related to unit costs, work 
standards and utilization of resources. They are an ex- 
tension of throughput measures in that they often in- 
volve a manipulation of throughput measures to obtain 
comparisons, etc. Some examples of efficiency oriented 
programs include those of the following. 


KANSAS CITY, MISSOURI 


In response to the recommendations of the National 
Commission on Productivity, Kansas City, Missouri, 
has launched a productivity program based on effi- 
ciency measures with the help of a full-time industrial 
engineer hired for that purpose. The program is ‘based 
upon the use of industrial engineering techniques to 
establish work standards, improve scheduling and 
work flow, evaluate the need for and benefits that can 


be derived from new equipment, develop new methods 
and techniques and generally call to the attention of city 
forces the need to increase productivity.’4 This program 
has been successfully implemented in several depart- 
ments where it has been based on throughput measures. 
Counselling and participative management were incor- 
porated and the emphasis was placed, not so much on 
individual measurement as on team planning and per- 
formance. 


WILMINGTON, DELAWARE 


In company with so many other municipalities in the 
early 1970’s Wilmington, Delaware, felt the need for 
service delivery productivity improvement and cost re- 
ductions. Efficiency measures helped the city to do this 
in a number of areas, including garbage collection.® 


Wilmington, a municipality on the u.s. Eastern Sea- 
board has a population of 80,000 but it is also the urban 
centre for over 300,000 residents in the surrounding 
area. The city has 36 household collection routes in its 
garbage pick-up operation. Twice a week, eighteen col- 
lection crews, each composed of five men, would pick 
up garbage on these routes from the backyards, alleys 
and curbs. These crews worked four days a week. As an 
efficiency incentive the crews worked on a task 

basis — the men could go home once their route was 
completed and the truck emptied. Regardless of the 
number of hours they actually worked to complete their 
routes the men were paid as if they had worked ten 
hours in a day or forty hours per week. 


During union negotiations the management undertook 
a study of the garbage collection activities on an effi- 
ciency basis. A review of the daily time sheets showed 
that the average garbage collection crew worked a total 
of 23.42 hours per week. Since each man was paid for 
40 hours the effective hourly rate was considered exces- 
sive. 


A further in-depth efficiency study revealed the follow- 
ing statistics. 


Wilmington Performance Measures 


0.64 minutes 
121.8 minutes 


Average collection time per stop 
Average manpower minutes per ton 


Average pounds per stop 52.8 pounds 
Cost per stop $0.824/stop 
Cost per ton $31.19/ton 
Stops per crew per day 546.1 stops/crew/day 
Lunch break 30 minutes 


Landfill Haul Time 40 minutes/trip 


Comparing these figures with the results of a com- 
prehensive survey of U.S. city costs, Wilmington found 
that its costs were over 75% higher than the national 
average, whereas the work week was significantly less 
than average. The city subsequently decided that crew 
sizes should be reduced by 45%, i.e. from five to three 


4 See Performance Measurement Programs, Kansas City, Mis- 
sourl, Appendix 1. 

5 See Performance Measurement Programs, Wilmington, Dela- 
ware, Appendix I. 
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operators. No employees were to be laid-off and pay 
levels would be adjusted to compensate for the extra 
work load. It was determined that the three man crew 
would still be able to complete their assigned routes in 

less than 40 hours. These actions brought union back- 
lash but the decisions held. 


After two years in operation it was found that the work 
week was only increased by approximately three hours 
to an average of 26.51 hours per week. It was also found 
that annual salaries in the division increased 22% over 


the two years while the divisional budget decreased by 

over 23%. In this case, efficiency measures had helped 

to identify problem areas and to indicate places where 
savings were possible. 


One important approach to efficiency involves work 
standards. These can be a useful measurement tool for 
planning and scheduling output. An example of precise 
output measurement and standard determination is 
given in the following planned work schedule for a 
parks maintenance groundskeeper. 


Work Schedule for Parks Maintenance Groundskeeper® 


Measured Standard 

Time Work task Work Hours Hours 
8:00 A.M. Check-in, get equipment 08 .08 
8:05 Travel to park site a5 so: 
8:20 Unload equipment 08 03 
$:25 Police 6 acres grass areas 1.08 LOS 
9:30 Rest break aD — 
9:45 Mow 4 acres grass areas IES 2.08 
12:00 P.M. Lunch — _— 
12:30 Mow 2 acres grass areas 1.00 1.04 
1:30 Clean 2 restrooms ze 68 
2145 Rest break =) — 
2:30 Grade and line baseball diamond 158 1.60 
4:05 Load equipment 08 03 
4:10 Travel to district office 25 Po 
4:25 Unload equipment, check-out 08 .08 
4:30 Off duty 08 .08 
8.00 es 


Total Hours? 


Utilization: 89.6% 


LITTLE ROCK, ARKANSAS 


A further example of the use of standards in efficiency 
measures is provided by the Little Rock, Arkansas, 
custodial services study.® The city found that its munic- 
ipal buildings were not kept clean even though a large 
number of custodial staff were employed. An attempt 
was made to determine whether the city should con- 
tinue to provide custodial services with its own staff or 
whether it should contract for these services. The study 
took the route of determining and comparing work time 
standards. Once established it was felt that these could 
be compared with expected results and with the results 
offered by local custodial service firms. 


6 94. 
Figures rounded. 


8 See Performance Measurement Programs, Little Rock, Arkansas, 
Appendix 11, 


The first aim of the study, therefore, was to find a 


comparison between effort expended and results ob- 


tained. Two techniques were employed to accomplish 
this. 


a Aration delay study. Ration delay is the observation 
and recording of those custodians working, not 
working, and away from their work area, at pre- 
established, randomly determined times throughout 
the day. The purpose of these measures was to assess 
personnel utilization. They gave measures of how 
much time was being lost and where it was being lost. 


b Engineered time standards. Time standards provided 
a frame of reference for comparing the tasks that 
were actually performed. The output of the custodial 
staff was compared with the output that could 
reasonably be expected from an average employee, 


working with average skill and effort, under normal 
working conditions. 


The standards were determined by cataloguing the 
areas to be cleaned and the work activities necessary to 
obtain a pre-determined level of service. An example 
may be ‘dust mopping floors with between two and six 
items of furniture per 100 square feet. The time stan- 
dard is 0.0124 hours per 100 square feet. The equip- 
ment or material standard would be a treated dust 
mop.’ 

Standard operating methods were determined, the 
standards developed and work loads calculated. The 
following is an example of such a work load calcula- 
tion. 


Workload Calculation 


A Task: Office Space 


Damp Mop and Buff 
57,564 ft.? 


B Standard Reference: 
C Standard Measure: 


UAD Jan 05.03 
.0390/100 ft.? 
D Time Requirement: (AxC) 22.45 hours 
Weekly (52 times/year) 
1167.4 hours (22.45 x 52) 
175.1 hours (13% x ¥F) 


1342.5 hours (F+ G 


E Frequency: 
F Annual Requirement: 
GEES Ds of 15% 


H Total Annual Requirement: 


* personal time, fatigue and normal delays 


These analyses showed that the custodial staff were 
working at well below what was calculated to be a 
reasonable average. The ‘effect’ side involved dividing 
the number of hours worked into the total salary and 
fringe benefit cost. This gave a cost per hour of effort. 
The ‘results’ side involved dividing the number of pro- 
ductive hours into the total cost. This gave a cost per 
hour of results. The difference between ‘effort’ and 
‘results’ gave an indication of unproductive cost. 


When the total annual work load costs were deter- 
mined, bids were solicited for custodial maintenance 
service. It was found that the lower bids from the local 
contractors were considerably below the present cost 
and even below the cost which would be incurred if the 
performance were improved to near standard. 


The city decided that ‘on the face of it, there was but one 
logical choice; contract for custodial services.’ 


The following are examples of the work unit break- 
downs and pre-determined engineering standards. As 
can be seen, the standards are very precise examples of 
work unit breakdown specifications. 


Examples of Work Unit Breakdowns 


Frequency code: 


Frequency Legend 

A 5XW Daily - 5 Days Per Week 
B 1ixW Weekly 

Caixik Yearly 

Baxi: Three Times Yearly 


Services proposed 


A General Offices Cleaning (Tile Floor), trash and util- 
ity, square footage 44,956. Frequency 5xW, except 
where noted. 


1 Furniture and Files: 
a Dust with chemically treated dust cloths. 
b Cleaned as per manufacturer’s instructions. 


2 Ash Trays: 
a Empty and wipe clean of all residue. 


3 Wastebaskets: 
a Empty and wipe clear. Remove contents to 
designated areas. 
b Wash and/or polish — Every 2 months. 


4 Walls: 
a Spot clean — Weekly. 


b Dust or vacuum — Every 2 months. 


>* Doors: 
a Dust — Weekly. 


6 Pictures and Display Cases: 
a Cleaned — Monthly. 


7 Floors: 
a Resilient tile and concrete. Dust mop with 
chemically treated dust mops. 


8 Glass: 
a Partition glass: 
i Spot cleaned. 
ii Cleaned both sides — Monthly. 


B General Offices Cleaning (Carpet Floor). Frequency 
S5xW, Square footage 6,117. 


1 Furniture and Files: 


a Dust with chemically treated dust cloths. 
b Cleaned as per manufacturer’s instructions. 


2 Ash Trays: 
a Empty and wipe clean of all residue. 


3 Wastebaskets: 
a Empty and wipe clean. Remove contents to 
designated areas. 
b Wash and/or polish — Every 2 months. 


4 Walls: 
a Spot clean — Weekly. 
b Dust or vacuum — Every 2 months. 


5 Doors: 
a Dust — Weekly. 


6 Pictures and Display cases: 
a Cleaned — Monthly. 


7 Carpets: 
a Vacuum and spot clean. 


8 Glass: 
a partition glass: 
i spot cleaned 
1 cleaned both sides — Monthly. 
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Examples of Work Standards 


Operation 


Damp 
Mopping 


Machine 
Scrubbing 


Wet 
Mopping 


Strip 
and 
Wax 


84 


.0001 


Variable or Type Range Hours 
Light soil-(1) 

item of furniture 100 sq. ft. .0267 
per 100 sq. ft. 

Heavy soil-(1) 

item of furniture 100 sq. ft. .0441 
per 100 sq. ft. 

Light soil-(2-6) 

items of furniture 100 sq. ft. .0390 
per 100 sq. ft. 

Heavy soil (2-6) 

items of furniture 100 sq. ft. .0511 
per 100 sq. ft. 

Heavy or light 

soil-(7 or more) 100 sq. ft. .0484 
items of furniture 

per 100 sq. ft. 

Stairs-(4) 

steps - 5 ft. long 4 steps 191 
Landings-up 

to 100 sq. ft. Each .0330 
All soil conditions 

(1) item of furniture 100 sq. ft. .0402 
per 100 sq. ft. 

Light soil-(1) 

item of furniture 100 sq. ft. .0467 
per 100 sq. ft. 

Heavy soil-(1) 

item of furniture 100 sq. ft. .0611 
per 100 sq. ft. 

Light soil-(2-6) 

items of furniture 100 sq. ft. .0660 
per 100 sq. ft. 

Heavy soil-(2-6) 

items of furniture 100 sq. ft. .0781 
per 100 sq. ft. 

Heavy or light 

soil-(7 or more) 100 sq. ft. .0754 
items of furniture 

per 100 sq. ft. 

Stairs-(4) 

steps - 5 ft. long 4 steps 0358 
Landings-up 

to 100 sq. ft. Each 0523 
Floor-(1-6) ; 
items of furniture 100 sq. ft. 1132 
per 100 sq. ft. 

Floor-(7 or more) 100 sq. ft. ABTS 


items of furniture 


3 Effectiveness 


Effectiveness measures have been broken down into 
expert judgement, user response and goal and objective 
achievement. Each will be illustrated separately. 


a EXPERT JUDGEMENT 


An example of the use of expert judgement in perfor- 
mance measurement is found in the City of Fort 
Worth’s productivity improvement projects. 


Fort Worth uses a street cleanliness rating system keyed 
to the use of a supervisor in the street cleaning program. 
The Assistant Public Works Director outlines the sys- 
tem as follows.® 


The supervisor rates the cleanliness of a swept street 
as satisfactory, poor, or unsatisfactory. In the eventa 
poor or unsatisfactory rating is achieved, the 
sweeper operator is required to resweep the street 
and a significant number of these ratings are trans- 
lated into the employee’s evaluation report. We have 
centralized the street cleaning efforts under one 
supervisor and radio equipped our sweeper fleet and 
front-end loading trucks to achieve a higher level of 
productivity and positive supervisory control of the 
cleaning operation. The program is currently view- 
ing modification in its second year with a study 
underway fora task incentive system and equipment 
modifications to permit more efficient mechanical 
cleaning of the street surface. 


Our current cleaning operations include five nightly 
cleanings of the central business district and adjacent 
area each week, the weekly cleaning of all underpas- 
ses and major thoroughfares, and the monthly clean- 
ing of arterial and collector streets with residential 
cleaning on an as-needed basis. Since the innovation 
of our cleanliness rating program we have been able 
to reduce our staffing by three street sweeper 
operators and have been able to maintain the same 
level of service. This has resulted in a savings in 


personnel and equipment operating costs in excess of 
$50,000 per year. 


b USER RESPONSE 


User response is also a useful gauge of how well a job is 
done. Quite often this measure is achieved through 

formal surveys of clients or citizens benefitting from the 
municipal services. The following is an illustration of a 


citizen survey for the evaluation of an intensive street 
cleaning campaign. 


9 See Performance Measurement Programs, Fort Worth, Texas, 
Appendix 11. 
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amie aa-vou chinkrolethercleaminess ite ces ee Fe hy ee oe ee ee 


eee eee Sireets: Docvou think the Strect is: 


—_________ Mostly clean, but dirty in a few places 


Fairly dirty 


pee VELY. CILTY ( Don’t know 


or no opinion) 


What do you think of the cleanliness of the alleys in your neighbourhood? Do you think the alleys are: 
ee can 
Mostly clean, but dirty in a few places 
Fairly dirty 


ee Vict Gilly, (Qe ee ee ee ON KROW 
or no opinion) 


What do you think of the overall cleanliness of your neighbourhood? 
Clean 
Mostly clean, but dirty in a few places 

eee aie ly dinty. 


Very dirty (ee S yee le a ee Dorielenow 
or no opinion) 


Have you noticed any change in the cleanliness of streets and alleys in your neighbourhood in the last 3 or 4 
months? (If response is ‘No’, go to #6 or #8): 


ee eee ho 


No (Ee ae Ee ee) Of eK LOW 
or no opinion) 


Are the streets and alleys now: 
__ Somewhat cleaner ___ sd Somewhat dirtier 


Very much cleaner Very milchrdiriler 


(Ask #6 and #7 if a special cleaning or collection operation is being evaluated. Otherwise go to #8.) 


Do you know what Operation (insert name of special operation) is? 


Yes 


er ae ge ING (eae IN OUSUEC) 


Peano nik ok DCLOLION toe =e Se ee eo ee eee St 
made a lasting effect on the cleanliness of streets and alleys: 


pee ies 

ee eG 

Pps RC Cit yn tiem Sg ee eee ter a ee PE mere 2d oe es eollectivounitrash.and garbage? 
ee er 145) C6 (__—dDon’t know. If no, or don’t 


know, terminate unless private 
contractors are being evaluated.) 
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9 How often do the collectors miss picking up trash and garbage on schedule? Do they: 


____ Hardly ever miss (or never except 
for holidays and bad weather) 


____. Miss about once a month (___——dDon’t know 
____ Miss more than once a month or no opinion) 
10 How often do the collectors spill trash and garbage or leave some that you have set out? Do they spill or leave 
some: 
__ Hardly ever (or never) 
____ About once a month (___——dDon’t know 


____ More than once a month or no opinion) 


11 How often do the collectors make so much noise that it bothers you? 
____. Hardly ever (or never) 
___ ss About once a month (eee Dortknow 


More than once a month or no opinion) 


12 How often do you notice widespread odors from uncollected garbage? 
_________ Hardly ever (or never) Gee 2 2 Frequentiy) 
__ sd Occasionally during hot weather (ee SDocr Pow 
or no opinion) 
13 Have you been dissatisfied with your trash collection service at any time and for any reason in the last twelve 
months? 
aL ies 


a NS 


(If Yes, write in reason they gave: 


14 Have you complained to the city government about the cleanliness of streets and alleys or refuse collection 
services in the last twelve months? 


Fa Me VER 


eee ee ING 
15 How many times? 


16 Were the conditions about which you complained corrected? 
___. Always 
eae Saale 


__ sd Seldom, if ever 


¢ COMBINING EXPERT JUDGEMENT AND USER Citizen perception of travel convenience. 
RESPONSE Travel Time 


The following represents the type of information that 
can be obtained through the use of both expert judge- 
ment and user responses for a local transportation 


Time required to travel between major origin and 
destination points. 


Congesti 
eohes 2 gestion duration and severity of delay. 
ae : Comfort 
Accessibility and Convenience 
gee ie Index of road surf i i 

Percent of residents not within ‘x’ minutes of public ausiace: Quality \DuUipiiGss a 

transit service or more than one hour from key desti- Citizen perception of travel comfort. 

nations. ae 
EEE ; , Examples of indicators of effectiveness for waste collec- 
11 85 tion and recreation services that combine expert judge- 
Hares ment, user response and available records, are as 

follows.12 
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Key Result 
Area 


Quality 
Characteristic 


Specific 
Measure 


Data Collection 
Procedure 


WASTE COLLECTION 


Health and 
Safety 


Pleasing 
Aesthetics 


Minimum 
Citizen 
Inconvenience 


Health Hazards 


Fire Hazards 


Fires Involving 
Uncollected Waste 


Rodent Hazard 


Rodent Bites 


Injuries to 
Solid Waste 
Collectors 


Street and 
Neighbourhood 


Cleanliness 


Offensive 
Odors 


Objectionable 
Noise Incidents 


Unsightly 
Appearance 


Missed 
Collections 


Spillage of 
Trash and 
Garbage 
During 
Collections 


1 Percentage of blocks 
with/without one or 
more health hazards. 


2 Percentage of blocks 
with/without one or 
more fire hazards. 


3 Number of fires 
involving uncollected 
solid waste. 


4 Percentage of house- 
holds reporting having 
seen/not seen one or 
more rats on their 


block. 


5 Number of rodent 
bites reported per 1,000 
individuals. 


6 Number of man-days 
lost due to injuries per 
1,000 days paid. 


7 Percentage of blocks 
whose appearance is rated 
unsatisfactory/satisfactory 
on visual rating scale. 


8 Average block cleanliness 
rating. 


9 Percentage of households 
reporting/not reporting 
offensive odors. 


10 Percentage of households 
reporting/not reporting 
objectionable noise during 
solid waste collection 
periods. 


11 Percentage of blocks 
with/without abandoned 
automobiles. 


12 Percentage of collection 
routes completed/not 
completed on schedule. 


13 Percentage of households 
reporting/not reporting 
missed collections. 


14 Percentage of households 
reporting/not reporting 
spillage by collection crews. 


Systematic visual inspection 
of a representative sample of 
city streets. 


Same as above 


Fire Department records. 


Citizen survey of a represen- 
tative set of city households. 


City-county health records 
along with the latest plan- 
ning department population 
estimates. 


Sanitation Department 
record. 


Systematic visual inspection 
of a representative sample of 
city streets using a photo- 
graphic rating guide. 


Systematic visual inspection 
of a representative sample of 
city streets using a photo- 
graphic rating guide. 


Citizen survey of a represen- 
tative set of city households. 


Citizen survey of a represen- 
tative set of city households. 


Systematic visual inspection 
of a representative sample of 
city streets. 


Sanitation Department 
records. 


Citizen survey of a represen- 
tative set of city households. 


Same as above. 
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Key Result 
Area 
Minimum 
Citizen 


Inconvenience 
(cont'd) 


General 
Satisfaction 


RECREATION 


Enjoyable- 
ness 
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Overall Citizen 
Neighbourhood 


Cleanliness 
Rating 


Citizen 
Satisfaction 


User 
Satisfaction 


Usage— 
Household 
Participation 


Usage— 
Individual 
Participation 


Usage— 
Attendance 
Helpfulness— 
Attitude of 
Staff 


Crowdedness 


16 Percentage of households 
rating overall neighbour- 
hood cleanliness as 
satisfactory/unsatisfactory. 


1 Percentage of households 
rating neighbourhood park 
and recreational opport- 
unities as satisfactory/ 
unsatisfactory. 


2 Percentage of those house- 
holds using city park 
recreation facilities who rate 
them as satisfactory/ 
unsatisfactory. 


3 Percentage of households 
using/not using a city park 
or recreation facility one or 


more times over the past three 


months. (For non-users, also 
suggested is the measure: the 
percentage who do not use 
for each of a number of 


reasons, with those that are at 


least partly controllable by 
the city distinguished from 
those that are not.) 


4 Percentage of individuals, 
by age group, using a city 


park or recreation facility one 


or more times over the past 
three months. 


S Number of visits at 
manned recreation sites. 


6 Percentage of user house- 
holds rating helpfulness- 
attitude of staff as 
satisfactory/unsatisfactory. 


7 Percentage of user house- 
holds rating crowdedness of 
city facilities as 
satisfactory/unsatisfactory. 


8 Percentage of non-user 
households which give 
crowdedness as a reason for 
non-use of facilities. 


Quality Specific Data Collection (cont'd) 
Characteristic Measure Procedure 

Damage to 15 Percentage of households Same as above. 

Private reporting/not reporting 

Property by damage to personal property 

Collection by collection crews. 

Crews 


Citizen survey of a represen- 
tative set of city households. 


Citizen survey of a represen- 
tative set of households. 


Citizen survey of represen- 
tative set of households. 


Citizen survey of a represen- 
tative set of households. 


Statistics kept by most 
agencies. 


Citizen survey of a represen- 
tative set of households. 


Same as above. 


Same as above. 


Key Result Quality Specific Data Collection (cont'd) 
Area Characteristic Measure Procedure 
Physical User 9 Percentage of user house- Same as above. 
Attract- Satisfaction holds rating physical 
liveness attractiveness as satisfactory/ 
unsatisfactory. 
Non-user 10 Percentage of non-user Same as above. 
Satisfaction households which give lack 
of physical attractiveness as 
reason for non-use. 
Facility 11 Percentage of user house- Same as above. 
Satisfaction holds rating cleanliness as 
satisfactory/unsatisfactory. 
Equipment 12 Percentage of user house- Same as above. 
Condition holds rating condition of 
equipment as satisfactory/ 
unsatisfactory. 
Safety Injuries to 13 Number of serious Accident and attendance 
Participants injuries (e.g. those requiring — statistics kept by most 
Resulting hospitalization) per 10,000 recreation agencies. 
from Accidents participants. 
Criminal 14 Number of criminal Criminal incident statistics 
Incidents incidents per 10,000 kept by some park and 
attendees. recreation agencies and most 
municipal police forces. 
Attendance statistics kept by 
most recreation agencies. 
User 15 Percentage of user house- Citizen survey of represen- 
Satisfaction holds rating safety of tative set of households. 
facilities as satisfactory/ 
unsatisfactory. 
Non-user 16 Percentage of non-user Same as above. 
Satisfaction households which give poor 
safety as a reason for non-use 
of municipal facilities. 
Access- Physical 17 Percentage of citizens who Counts from mapping of 
ibility Accessibility live within/not within, 15/30 latest census tract population 


Hours of 
Operation 


minutes travel time of a city 
park or recreation facility. 
(Distinguished by type of 
facility and the primary 
transportation mode relevant 
for the facility type.) 


18 Percentage of non-user 
households which give poor 
physical accessibility as a 
reason for non-use. 


19 Percentage of user house- 
holds rating hours of 
operation as 
satisfactory/unsatisfactory. 


20 Percentage of non-user 
households which give poor 
operating hours as a reason 
for non-use. 


figures against location of 
facilities with appropriate 
travel time radius drawn 
around each facility. 


Citizen survey of a represen- 
tative set of households. 


Same as above. 


Same as above. 
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Key Result Quality Specific Data Collection (cont'd) 


Area Characteristic Measure Procedure 
Variety Program 21 Average number of differ- Recreation agency records. 
Variety ent program activities per 
facility. 
User 22 Percentage of user house- Citizen survey of a represen- 
Satisfaction holds rating the variety of tative set of households. 


program activities as 
satisfactory/unsatisfactory. 


Non-user 23 Percentage of non-user Same as above. 
Satisfaction households which give poor 

program variety as a reason 

for non-use. 


These effectiveness measures can, of course, be tied to The goal is to provide an on-going, in-house, effective- 
efficiency measures. The relationship between them can ness productivity measurement and analysis system 
be seen in the following example from Palo Alto, which can provide a score card of the performance of 
California.12 Palo Alto is implementing what is consi- public services, as they relate to the citizens. 


dered to be one of the most advanced applied perfor- 
mance measurement systems in North America. 


Examples of Measures of Effectiveness and Efficiency — Palo Alto, California 


Service Effectiveness Efficiency 


Recreation 1—% of households which feel 1 Cost per citizen served. 
recreation opportunities are very good. 


2—Number of serious accidents per 2 Number of class hours provided 
100,000 per man-year. 


3—Total attendance at facilities and 
programs. 


4—Average number of different 
programs per facility. 


Library 1—Citizen rating of hours of operation. — 1 Number of books circulated per 
$1000. 
2—Total circulation. 2 Cost per reference handled. 


3—Number of different books by type. 


4—% of citizens who rate the library 


very good. 
Solid Waste 1—% of citizens who are satisfied 1 Tons collected per $1000. 
and Street with service. 
Cleaning en 
2—Rate of injuries to waste collectors. 2 Cost per unit served. 
3—Cleanliness rating for streets. 3 Tons collected per crew. 


4—Number of objectionable noise 
incidents. 


13 See Performance Measurement Programs, Palo Alto, California, 
Appendix I. 
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Examples of Measures of Effectiveness and Efficiency — Palo Alto, California (cont'd) 
Service Effectiveness Efficiency 
Transportation 1—Citizen perception of travel 1. Costeper trip, 
convenience. 
2—Rate of transportation related 2 Pot holes repaired per $1000. 
deaths, injuries and incidents of 
property damage. 
3—Road surface quality. 
4—% of residents not within “‘X”’ 
distance of public transit service. 
Water 1—Number of coliforms per litre. 1 Cost per gallon. 


Waste Water 
Treatment 


Storm Drain 
System 


Police 


2-% of citizens who rate the city 
supplied water acceptable on 
appearance, odor and taste. 


3—Number of valid complaints about 
water pressure not shown to be due to 
causes outside city responsibility. 


4—Time required from request for 
service to completion of hook up. 


1—BOD. 


2—% of sewage not being treated. 


1—Dollar value of damage due to flood- 
ing per $100,000 of market value per 
year. 


2—Number of hours per year of road 
impassibility at key intersections due 
to flooding. 


1—Reported crime rates. 


2—% of people afraid to walk in their 
neighbourhood at night. 


3—% of reported crimes cleared 
by arrest. 


4—% of arrests not surviving 
preliminary court hearing. 


5—Overall % of valuables stolen that is 
subsequently recovered less 
damages. 


6—Average response time. 


2 Water mains repaired per crew-day. 


1 Cost per 1,000,000 gallons treated. 


2 Cost per pound BOD. 


1 Cost per catch basin rebuilt. 


2 Miles of sewer maintained 
per $1000. 


1 Population served per $1000 of 
police expenditure. 


2 Number of cases investigated 
per detective. 
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d THE ACHIEVEMENT OF GOALS AND OBJECTIVES 


The achievement of goals and objectives is also a meas- 
ure of effectiveness. An example of this approach is 
given by the District of Burnaby, B.c. In 1976, Burnaby 
worked towards the establishment of a goal and objec- 
tive system in its efforts to measure performance and to 
promote good management by the union exempt 
staff.14 


The system which was established, basically focussed 
on the relationship between a superior and subordinate. 
Atthe initial meeting the two discussed what is involved 
in the subordinate’s job, including a specification of the 
purpose for the position and an identification of the 
responsibilities associated with the job. When these 
have been established the subordinate has a clear idea of 
what he is accountable for and what end results are 
expected. This will give him an indication of measure- 
ment criteria and goal or attainment areas. 


Both sides then agree on specific measures or yardsticks 
of accomplishment in the attainment area. These meas- 
ures may be throughput, efficiency or other effective- 
ness measures. At this time levels of measurement are 
also set, e.g. what would be considered competent or 
marginal. Once these factors have been established 
goals can be set to be accomplished within the next time 
period.15 


The purpose of this meeting, or series of meetings, is to 
assure that each side is clear on the subordinate’s role 
and responsibility and on what is expected of the sub- 
ordinate over the next period, usually one year. 


Periodically, usually on an annual basis, superior and 
subordinate meet again to discuss progress. The meet- 
ings are set to discuss: 


1 how well the goals set earlier were met and what 
‘rating’ could be ascribed to the performance against 
each goal; 


2 what areas of performance, other than those for 
which specific goals were set, deserve to be rated and 
what rating should be ascribed to them; and 

3. what realistic goals are attainable within the next 12 
months. 


In all of these meetings the emphasis is on open discus- 
sion, communication and participation on both sides. 


USING THROUGHPUT, EFFICIENCY AND EFFECTIVENESS 
MEASURES WITH GOALS AND OBJECTIVES 


As noted in the Burnaby example, throughput and effi- 
ciency measures are often needed to determine the ex- 
tent to which goals and objectives are achieved. The 
following examples provided by the City of Fort 
Worth!6 are good indicators of the relationship bet- 
ween goals, objectives and the other types of output 
measures. Departments from which these examples are 
drawn include police, financial administration, pur- 
chasing and stores, and data processing. 


Police Department 


Goal 


To maintain a sufficient number of properly recruited, 
thoroughly screened, and completely qualified applic- 
ants immediately available to fill any vacancy occurring 
in the Fort Worth Police Department thereby insuring 
that the citizens of Fort Worth are provided with a 
properly staffed police department. 


1974-75 Objectives 


To provide qualified applicants to fill vacancies oc- 
curring in the Police Department. 


To increase the ‘population base’ for selecting qual- 
ified police applicants. 


To improve the quality of background investigations 
on applicants for sworn and civilian positions in the 
Police Department. 


To increase the ethnic minority ratio of sworn offic- 
ers in the department. 


more Actual Estimate Target 
Measures of Efficiency and/or Effectiveness: 1972-73 1973-74 1974-75 

Number of police and cadet applicants 284 668 750 
interviewed and processed. 

Number of background investigations completed 106 27 146 
Number of background investigations 75 Vp 90 
accepted by Review Board. 

Number of background investigations completed free from N.A. 100 140 

any unresolved investigative leads. 

Number of ethnic minority persons employed as 32 47 82 


sworn Officers 


14 See Performance Measurement Programs, Burnaby, B.c., Ap- 
pendix 1. 

15 The use of goals as definitive targets differs from the LGMP usage 
of the term. These would be objectives in LGMP terminology. 

16 See Performance Measurement Programs, Fort Worth, Texas, 
Appendix I. 


Goal 


To eliminate crimes perpetrated by juveniles in the City 
of Fort Worth and to insure that all juveniles who 
commit crimes are extended an opportunity to redirect 
their behaviour toward normal social activity. 


1974-75 Objectives 
To increase the clearance rate on juvenile offenses. 


To reduce the rate of juveniles who are handled more 
than one time. 


To increase contacts between juvenile offenders and 
officers under non-adverse conditions. 


Actual Estimate Target 
Measures of Efficiency and/or Effectiveness 1972-73 1973-74 1974-75 
Juvenile offenses reported 7,154 7,418 6,677 
Offenses cleared 4571 4,821 4,673 
Percent of recidivism P15 10:1 7% 9.15% 
Percent of juveniles reached with follow-up contacts N/A 13% 14.3% 
Average case clearance rate/officer N/A 11% 12:1% 
Referral to social agencies N/A Sse wih ye 
Establishment checks N/A 720 800 
Financial Administration Department 
Goal 
Provision of all effective financial information to the 
City Council and City Manager on a timely basis and all 
necessary assistance to reporting managers in achieve- 
ment of their approved goals and objectives, and the 
profitable, safe investment of all idle City funds. 
1974-75 Objectives 
Positive response to all requests for information 
from the City Council and City Manager within 
specified time limits. 
Reduction of non-invested funds. 
Achievement of the objectives of managers reporting 
to this activity. 
Actual Estimate Target 
Measures of Efficiency and/or Effectiveness 1972-73 1973-74 1974-75 
Percentage of requests for information 75.0% 80.00% 100.00% 
completed within allotted time 
Ratio of non-invested funds to total funds available 2.5% 2.25% 2.00% 
Ratio of number of objectives achieved by managers N/A N/A N/A 


to total number of objectives 
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Purchasing and Stores Department 


Goal 


To secure quality materials and equipment for City 
departments at the best available competitive prices 
with best available delivery time. 


1974-75 Objectives 


To encourage and promote more competitive bid- 
ding through the expansion of the vendor search file. 
To increase the number of companies bidding on 
purchase items by increasing the number of bid invi- 
tations mailed, in order to achieve a higher average 
of bid quotations per purchase order. 


To increase the percentage of purchase requests pro- 
cessed within deadlines. 


Goal 


Actual Estimate Target 
Measures of Efficiency and/or Effectiveness 1972-73 Dae 1974-75 
Bid invitations mailed 8,059 8,500 9,000 
Average bid quotations per purchase order N/A 3 oP 
Percent requests processed within deadline N/A 95% 95% 
Properly anticipate and have readily available all repair 
parts and maintenance supplies required to maintain 
the City’s fleet. 
1974-75 Objectives 
‘Lo increase the percentage of parts requisitions that 
can be filled immediately from stock. 
To reduce the average acquisition time for parts from 
local sources. 
To reduce the year-end losses from parts obsoles- 
cence, through improved controls over restocking 
and stock exchanging. 
. Actual Estimate Target 
Measures of Efficiency and/or Effectiveness 1972-73 1973-74 1974-75 
Parts requisitions filled from stock 56% 60% 65% 
Average parts acquisition time from local sources (in hours) 1. 5(est:) Lest) 1.0 
Percentage of year-end inventory losses 1.5% 1 1.0% 


due to parts obsolescence 
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Goal 


To provide as efficiently as possible an effective mainte- 
nance program that will quickly respond to all service 
requests and restore disabled equipment to prime 
operating condition as soon as possible. 


1974-75 Objectives 


To reduce the number of repair jobs which exceed 
the time specified by the standard job labour rate, 
established by motor equipment manufacturers. 


To reduce response time for on-site aid to units dis- 
tressed in the field. 


Through work scheduling refinements, administra- 
tive controls, and incentives, reduce average repair 
related downtime. 


Measures of Efficiency and/or Effectiveness 


Actual 
1972-73 


Estimate 
1973-74 


Target 
1974-75 


Average job time excess over flat rate 
Average elapsed time (in hours) for on-site aid 


Average repair related downtime (in hours) 


15%: (Est.) 
Pee (ests) 
4.0 (est.) 


10% (est.) 
1.0 
3.2 (est.) 


8% 
Aid) 
a) 


Data Processing Department 
Goal 


To provide an efficient and effective service which will 
continually meet all automated information processing 
needs of City departments and related agencies. 


1974-75 Objectives 


To increase the ratio of accurate information to the 
total information provided to all City departments/ 
agencies during the next fiscal year. 


To increase the ratio of accessible, readily usable 
information to total information provided to all City 
departments/agencies during the next fiscal year. 


To increase the ratio of the number of requests for 
Data Processing services processed on schedule and 
within budget to the total number of requests proces- 
sed for all City departments/agencies during the next 
fiscal year. 


Measures of Efficiency and/or Effectiveness 


Actual 
MI 2ey 3 


Estimate 
1973-74 


Target 
1974-75 


Number of requests processed for program 
or system modification 


Number of requests processed for new or special reports 


User service ratings of Data Processing Services 
in percentages 


Productivity, ratio of accurate and on time jobs processed 


to total processing time in jobs/hr. 


Average terminal response time in seconds 


Project/task performance, the ratio of items completed on 


time and within budget to total project/tasks completed 


N/A 


N/A 
N/A 


N/A 


N/A 
N/A 


160 


40 
72 


6.10 


a0 
ae 


eps 


42 
84 


6.11 


5.0 
.80 
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B FISCALLY ORIENTED MEASURES 


The following examples represent recent attempts to 
incorporate performance measurement into the 
budgetary process. These attempts are grouped under 
the headings of planning programming budgeting sys- 
tem (pps) and zero based budgeting (ZBB). 


Planning programming budgeting (PPB) 


LAKEWOOD 


Since 1975 the City of Lakewood, Colorado,” has 
embraced the concept of ppB enthusiastically. In 1976, 
the Municipal Finance Officers’ Association awarded 
the city its Louisville Award in recognition of the work 
that Lakewood had undertaken in the budget reform 
area. 


The 1977 budget followed the pattern established in the 
previous two years of breaking down the budget into a 
program format giving indications of performance and 
performance objectives. Along with the program 
breakdown, the budget was also presented by depart- 
ment giving expenses for personnel, operation and 
maintenance, supplies, charges and services and capital 
outlay. 


The program breakdown for 1977 was as follows. 


Programs 

Safety Traffic regulation 
Law enforcement 
Judicial system 
Enforcement 
Support services 

Transportation Street improvement 


Street maintenance 
Mass transportation 


Environment City environment 


Drainage systems 


1 / See Pertor mance Measurement I rogr ams, Lake wood Colorado 
> , 
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Leisure Recreation 

Parks 

Human resources 
Development Land use 

Housing 
Administration Representation 


General government 
Financial services 
Personnel services 
Legal services 
Support services 
Non-departmental 


Each of these programs was broken down into more 
specific operational programs. For instance within the 
‘Safety’ program a specific program of ‘Traffic Regula- 
tion’ was “Traffic Activities’. This was presented as 
follows. 


Program — Traffic Activities 


Program Description 


Provide traffic patrol and control traffic law enforce- 
ment. To include traffic accident investigation to facili- 
tate the safe flow of both vehicular and pedestrian 
traffic. 


Performance Objectives 
1 To prevent any increase in fatal traffic accidents. 
To decrease traffic injury accidents by 15.0%. 


2 

3 To decrease non-injury traffic accidents by 10.0%. 
4 To increase enforcement actions taken by 11.0%. 
5 


To insure patrol agents’ staff hours devoted to traffic 
activities do not exceed 15% of their total time. 


Indicators of Performance REIS) 1976 1977 
Measurement Objective Actual Estimate Projected 
Demand 
Department Objective: 
Time Budgeted for Patrol Agents >) 20% 11.3% 15% 
Registered Vehicles 1-5 935556 96,363 99158 
Total Traffic Accidents 1-3 5,901 4,876 4,388 
Workload 
Summons Issued 4 155912 12,935 14,500 
Accident Reports Prepared 1-3 5,463 4,876 4,388 
Percent Patrol on Traffic Activities 3 11396 11.3% 15% 
Productivity 
Time Spent per Summons 4 14 min 14 min 14 min 
Time Spent per Accident Report 4-5 40 min 40 min 40 min 
Effectiveness 
Percent Change: 
Fatal Accidents 1 +40% 0% 0% 
Injury Accidents 2 +6% — — 
Non-Injury Accidents 3 —. — — 
Analysis 
The number of accidents requiring a response by an 
agent will continue to decrease. This reflects an ex- 
pected drop in the number of injury/non-injury acci- 
dents and the continued policy of not responding to 
private property accidents. Cost decreases in this prog- 
ram are primarily due to adjusted motor pool charges 
and reduced expenditures for wearing apparel. 
Resources 
1975 1976 1976 1977 
Category Actual Budget Revised Budget 
Personnel — — = — 


Operating/Maintenance Supplies 
Charges & Services 

Capital Outlay 

TOTAL 


Source of Funds 


oF 


CINCINATTI 


The attempt by the City of Cincinatti!* to implement 
city wide performance budgeting appears to have been 
successful. As described by the director of the City’s 
Budget and Research Office, the main purpose was to 
stress both activity accounting and activity accountabil- 
ity through the use of an organizational coding system 
that captured expenses associated with individual work 
program performance. Under this approach,both per- 
sonnel complement and cost information data were 
recorded and reported for three organizational 

levels — department, division and section. Budgetary 
reports prepared for the operating agencies were based 
upon the work programs which were set up to parallel 
basic organizational units in a division. Provision was 
thus made for the collection of significant aspects of 
operating expense for the division head and his section 
supervisors. At the same time the need for both budget- 
ary and administrative latitude was recognized by mak- 
ing appropriations at the division level. 


Problems Encountered 


In areas where precise costing was necessary, e.g. utility 
operations, and on projects partly financed with match- 
ing funds from other governmental jurisdictions, the 
application of cost accounting was both simple and 
inexpensive. It is not clear, however, where the cut-off 
point was to be made, i.e. where cost information col- 
lection was to stop. (This early attempt at determining 
quality obtained for money spent, uncovered problems 
that are still being grappled with by municipalities.) In 
the engineering division, difficulty was encountered in 
establishing effective work units to measure project 
design and surveying. Accounting for manhours ex- 
pended by division personnel normally assigned to sev- 
eral work programs was also a problem. 


Another admitted problem was the difficulty of reflect- 
ing quality in such activities as inspections, purchasing 
or planning. 


In the case of planning, the City Planning Director 
endorsed performance budgeting but was also quick to 
point out that planning department work was not easy 
to measure. Work quality often took years to evaluate 
and often extraneous circumstances might affect that 
quality. 


In the purchasing area it was difficult to define a work 
unit. One of the objectives of the centralized purchasing 
office was to reduce the number of purchase orders 
issued through combined purchasing. Thus, the number 
of orders in itself did not reflect work effort involved. 


Two Part Budget 


In addition to the cost accounting system, Cincinatti 
employed a two part budget (a strategy which has since 
been adopted by many municipalities in their attempts 
to use PPB.) 


The purpose of this approach was to emphasize budget 


18 See Performance Measurement Programs, Cincinatti, Ohio, Ap- 
pendix 1. ; 


19 See Performance Measurement Programs, Los Angeles, Califor- 
nia, Appendix 1. 
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programs and requests that were worth more than just 
routine examination, by separating them from tradi- 
tional items where acceptance was generally a matter of 
course. Thus, fund allocations in the basic budget dealt 
with normal recurring activities already approved and 
operating. The basic budget represented operating 
needs based on the current level of personnel and the 
expected continuation ofa level of service already estab- 
lished. On the other hand, the supplemental budget 
dealt with requests that were beyond established levels. 
This budget included proposals for the expansion of 
existing services, the commencement of new ones and 
the expansion of personnel. 


The City realized the following advantages in utilizing 
the two part budget: 


1 the time spent on budget matters by the City Man- 
ager and the finance committee was reduced since 
controversial or complex budget matters were high- 
lighted for special attention; 


2 most of the basic budget requirements have been de- 
termined prior to the departmental budget hearings 
and are routinely handled; and 


3 the separate determination of budget requirements 
improved the accuracy of the City’s budgeting. 


Benefits 


Tighter control of monies spent, an increased awareness 
of accomplishment per dollar spent, and a more stream- 
lined budget approval process were some basic aims of 
the Cincinnati Office of Budget Research. Following a 
decade of experience with the system the office has 
reported that Performance Budgeting has turned out to 
be clearly superior to former systems. Key improve- 
ments have been; increased efficiency through its use by 
administrators as a managerial tool, more accurate and 
meaningful reporting of the budget to the public, the 
speeding up of the budget approval process, and more 
financially accurate future planning. 


In a historical context the Cincinnati experience was a 
precursor of subsequent municipal practice with regard 
to the improvement of performance through budgetary 
techniques. Municipalities today still use two part 

budgets as an attempt to expedite budget approval. The 
problems with justifying the value of cost accounting 
systems and ‘fine tuning’ them still exist, however, and 


new methods are constantly being examined in different 
locations. 


LOS ANGELES 


A six year experiment with performance measurement 
by the City of Los Angeles!® has produced mixed re- 
sults. While meaningful performance measures were 
established, significant differences were noted in the 
areas of design of the reporting system, management 


decentralization, and the degree of legislative participa- 
tion. 


Unlike the Cincinnati experiences, the Los Angeles at- 
tempt did not have any relationship with the accounting 
system. Originating from the City Administrator’s Of- 
fice, the performance budgeting system was originally 
intended to function on information coming to that 


office. However, as the CAO was unable to get the type 
of information he needed from the accounting area, he 
opted for the establishment of a reporting system built 
on resource expenditures by individual managers. 
While this substitute may have created extra work, it 
showed itself to be one of the more effective compo- 
nents of the system. Adopting a man-hour approach, 
the reporting system gathered data on two items: the 
number of units of work performed and the number of 
manhours required to perform those units. 


The basis for performance budgeting in Los Angeles has 
been its acceptance by both the elected and administra- 
tive bodies. The budget has acted as a form of contract 
between the two groups. While this concept did not 

originate with Los Angeles, the degree to which the 

execution of the budget was adhered to, as in a legal 
contract, was, in fact, quite a departure from normal. 


The idea of a contract was strongly upheld by the pres- 
ence of a particularly effective City Administrative Of- 
ficer. Chief among his responsibilities has been ‘con- 
tract control’. Acting as an intermediary between the 
administration and council, this appointed official has 
taken responsibility for assuring execution of the per- 
formance budget. This has been done chiefly through 
the initiation of ‘work programs’, the function of which 
was to provide reference points with regard to the tim- 
ing, size, and nature of expenditures. As a result of the 
emphasis on execution and accountability, a close rela- 
tionship developed between budget preparation and 
execution. Work programs were designed to form the 
basis for the original budget appropriations. An 
administration-wide reporting system which related 
units of work performed to manhours expended, pro- 
vided a check of actual versus proposed performance. 


A number of advantages were reported through the use 
of this system: 


1 the cao was able to keep informed on a wide range of 
operations using the single composite source of in- 
formation; and 


2 the information collected was often-times doubly 
useful, providing necessary input for reports to the 
Council, Mayor, etc. 


A natural result was the emergence of the CAO as quite a 
powerful figure in the City. In addition, the manage- 
ment of the City was viewed by most to have become 
more centralized. This is in contradiction to the normal 
expectation associated with performance budgeting 
— it is supposed to increase managerial delegation of 
responsibility and result in an increase in cost conscious- 
ness. In seeking to explain this contradictory result, 
Sherwood and Eghtedari point out that the very capable 
CAO at the time had realized that the City’s large and 
cumbersome departments were operating quite inde- 
pendently of one another. It was this realization which 
motivated the move towards centralization through the 
‘contract’ format. These authors point out that even 
though an effort was made by top management to in- 
volve lower level managers, communication upwards 
was not forthcoming, probably due to feelings of uncer- 
tainty and unwillingness to be ‘pinned down’ to com- 
mitments. This experience thus suggests how others’ 


priorities, in this case, the need for control over a very 
large organization, can offset the predicted results of the 
performance budgeting approach. In summary, it 
should be noted that increased productivity was 
achieved without resorting to the performance budget- 
ing prescription. 


Performance budgeting is supposed to enhance legisla- 
tive decision-making, by laying emphasis on program 
priorities, size, and timing rather than on program 
components and objects of expenditure across prog- 
rams. It was hoped that this emphasis on programs 
would generate more interest and participation at the 
elected level. The opposite occurred, however — in gen- 
eral, council hearings on the budget had generated little 
debate. This result again seems contradictory to per- 
formance budget expectations. 


In seeking an explanation for these apparent contradic- 
tions, interviews with the councillors showed that there 
was little appreciation of the performance budget re- 
view as a platform for policy changing. It was argued 
that since the performance budget is a more thoroughly 
researched document it had become politically risky to 
challenge its proposals, and so participation decreased. 
Yet this was not the sole cause, and the authors point 
out that this decrease in meaningful participation may 
have been simply a continuation of an existing trend. 
Councillors in Los Angeles are full time officials who 
meet daily with various committees and who are work- 
ing throughout the year with the Mayor, the cao and 
special interest groups. There is much time devoted to 
both policy and following the budget through its forma- 
tive stages. As a result, final approval of the budget has 
not, in recent times, been an important forum for 
change. 


The Sherwood and Eghtedari study of Los Angeles’ 
performance budgeting experiment reached some posi- 
tive conclusions about the system at the same time that 
it posed some interesting questions. The Los Angeles 
experience suggested that: 


1 the performance approach can result in a 
strengthening of the executive budget ... and can 
have an effect on program planning and the central 
control of decisions going into the executive budget; 


2 the measurement of work in a governmental juris- 
diction is practical and feasible and there are positive 
benefits to be gained from such measurement; and 


3 the performance budget need not be based on the 
accounting system. 


The following questions were raised. 


1 Does the performance budget tend to inhibit legisla- 
tive participation in the budget process? Does formal 
legislative participation in the budget process be- 
come less important (and perhaps unnecessary) 
when the legislative body is kept continuously aware 
of the financial condition and needs of the jurisdic- 
tions throughout the year? 


2 If we assume that an abdication of legislative in- 
volvement does take place, are we prepared to pay 
such a price for an increased grasp of budget deci- 
sions by the chief executive, plus the managerial 
benefits? 99 


3 How should performance information be used in 
managerial appraisal? Will we be able to develop an 
appraisal system (i.e. standards) sufficiently rational 
to make the accumulation of such hordes of data a 
useful expenditure of time? 


4 Instrengthening the executive, does the performance 
budget also set into motion forces incompatible with 
organizational decentralization? 


PHOENIX 


By 1969, the Phoenix?® City Council realized that some 
kind of wide-ranging planning and budgeting reform 
was needed if it was to be able to supply an increasing 
number of effective services to a growing city. Various 
groups in the city were voicing increasing concern over 
the cost of municipal government and increasing in- 
terest about where their tax dollars were going. These 
concerns resulted in a premium being placed on de- 
veloping programs based on community needs and 
well-defined goals and objectives. There had recently 
been considerable citizen participation in formulating 
overall goals for the city through the Phoenix Forward 
Program. Thus, it was important that municipal prog- 
rams and services be compatible with, and contribute to 
these goals, as approved by Council. Limited revenue 
sources made the establishment of relative priorities 
among competing programs extremely important. As 
the municipal government grew it became more impor- 
tant to have good procedures for making choices bet- 
ween programs and service levels and to be able to 
measure the efficiency and effectiveness of the City’s 
efforts. 


A nationally-known consulting firm was engaged to 
conduct a management study. This study reviewed the 
adequacy of the City’s budgeting system and operating 
procedures, assessed other management systems and 
techniques for planning, controlling and evaluating 
municipal services, and finally recommended the im- 
plementation of a PPB system over a period of three 
years. Council adopted this recommendation and emp- 
loyed the consultants to help with the implementation. 


By August 1970, the Budget and Research Department 
had been reorganized and expanded to enable it to 
provide internal guidance in bringing in the system, and 
a plan for introducing pps had been established. This 
plan set out fifty-plus steps (including some ‘go/no go’ 
decision points), assigned responsibility for each step to 
specific individuals, and provided target completion 
dates. The following practical considerations were in- 
corporated into the plan: 

1 central budget and research staff must first gain a 
working knowledge of ppp techniques; 

2 introduction of pps should be worked around the 
existing commitments of the Budget and Research 
Department; 

3 improving program analysis and assessment of prog- 
ram alternatives should be given top priority; 

4 there should be some immediate pay-off in the next 
fiscal year; and 


20 See Performance Measurement Programs, Phoenix, Arizona, 
Appendix 11. 
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5 pps efforts should follow a long-range and realistic 
plan. 


The first step taken was to school Budget and Research 
Department analysts in the basics of ppB and program 
analysis techniques. This step provided not only a staff 
group who could perform the analytical work called for 
by pps, but also a core of enthusiastic and committed 
supporters of the system. 


The second step called for the development of issue 
papers on several high priority program problem areas, 
designed to provide immediate pay-off from the train- 
ing of the analysts. 


Briefly, the steps in the implementation of the system 
were as follows (each step consisted of a number of 
sub-activities): 


1 formulate, review and approve a multi-year plan for 
PPB implementation; 


2 develop and install in several departments, perfor- 
mance reporting systems compatible with antici- 
pated future ppB developments; 


3 select one department and develop and install a pilot 
PPB system; 


4 carry out a pilot program of issue analysis in a high 
priority area; 

5 determine the usefulness and success of the pilot 
project; 

6 carry out three months of issue analysis in high 
priority areas; 


7 establish goals, objectives and program statements 
for each department for use in the budgeting and 
performance measurement processes; 


8 identify and select organizational units for PPB sys- 
tem expansion; 


9 develop guidelines and instructions for expanding 
the system into other departments; 


10 conduct orientation sessions for department and 
division heads in ppp concepts and further im- 
plementation plans; 


11 determine and resolve analytical staffing and train- 
ing needs in the various departments; 


12 select and train staff in the departments in PPB con- 
cepts and techniques; 


13 develop a design for a program review subsystem in 
participating departments; 
14 review and modify the program review subsystem; 


1S review and approve finalized program review sub- 


system and possible changes in the organization 
structure; 


16 establish data collection and performance review 
procedures to monitor progress of unit programs; 
and 

17 review the status of the pps implementation efforts 
and make further refinements of the system. 


The above steps were carried out in Phoenix over a 
period of about 40 months up to June, 1974. 


Each year from 1972, several ‘Program Analysis Re- 
views’ were carried out in selected departments by the 
analytical staff of the Budget and Research Department. 
These studies used classic ppp techniques, especially 
cost/benefit analysis, to set and revise program goals 
and objectives, determine present and desired service 
levels, evaluate program effectiveness and potential ser- 
vice level changes and related costs or savings. Such 
studies have now been carried out in almost all city 
departments, and several follow-up studies have been 
completed. 


Since 1973-1974, the annual budget has been presented 
in a program format including departmental goals and 
detailed operating objectives. Each of the nine program 
areas is broken down into a number of sub-programs. 
The ‘general government’ program area has the most 
with nineteen. The eight other program areas are crimi- 
nal justice, public safety, transportation, sanitation, 
community enrichment, water resources, urban de- 
velopment and housing, and economic development 
and opportunity. The transportation program will be 
used as an example. 


The transportation program area is made up of nine 
programs — street maintenance, street improvements, 
storm sewer improvements, public parking, traffic en- 
gineering, street lighting, aviation, transit, and trans- 
portation research. Using street maintenance as an 
example, the goals and objectives for that area are as 
follows. 


Street Maintenance Program Goal: 


Assist in providing for the safe and expeditious use of 
public streets and alleys through a regular street 
maintenance program, minimize danger to life and 
property through the control of irrigation and storm 
water, and assist in maintaining acceptable aesthetic 
standards for public streets and alleys. 


Example Program Objectives 


1 Repair all chuckholes on major and collector streets 
within 72 hours of notification compared to a de- 
sired level of response within 24 hours. 


1 Continue to grade 85 out of a desired 121 miles of 
unpaved Class D streets monthly. 


3 Mow weeds from the 162 miles of unimproved 
shoulders of major and collector streets four times a 
year to achieve desired objective. 


Sweep all 50 curb miles of downtown streets daily. 


5 Sweep 3,824 curb miles of local and low-use major 
and collector streets every 51/2 weeks compared to a 
desired level of every four weeks. 


6 Clean 95 miles of drainage ditches once every 7 
months to achieve 85% of desired objective cleaning 
every 6 months. 


City officials claim that their PPB system, with its em- 
phasis on productivity improvement, has resulted in 

substantial efficiency and effectiveness improvements. 
Because Phoenix has experienced considerable growth 
over the past few years, all savings have been in terms of 
cost avoidance rather than cost reduction but they have 
been considerable. The Work Planning and Control 


part of the program worked to improve the efficiency of 
employees, and by mid-1965, measureable manpower 
utilization had increased to the equivalent of 324 man- 
years since the start of the program. That 324 man- 
years constituted a cost avoidance saving of $3.1 
million.?1 


Program Analysis Review studies have resulted in im- 
proved methods in several aspects of the City’s opera- 
tions. For example, refuse collection crews were re- 
duced and operations were mechanized resulting in av- 
oided costs amounting to $3.6 million. Fire protection 
effectiveness was increased through improvements 
made as a result of Program Analysis Review recom- 
mendations. This had the effect of upgrading the City’s 
fire defence rating, resulting in lower insurance costs 
throughout the City. The cost/benefit ratio of the prog- 
ram has been estimated at 1 to 4"/2, or for every dollar 
spent on the program, $4.50 has been returned in be- 
nefits. 


Some problems have been encountered with the system. 
Confrontations between the consultant and staff 
analysts on one hand and line department officials on 
the other were frequent during the early stages because 
ofa desire by the former parties to move too quickly and 
to be able to show immediate results. Several minor 
labour grievances occurred as a result of changes in 
procedure made in the quest for efficiency. It was be- 
lieved that these could have been avoided if a more 
sympathetic and understanding approach to introduc- 
ing change had been adopted. 


In total, however, problems with the PPB system in 
Phoenix have been relatively slight. For the most part, 
the system was implemented slowly and deliberately 
and each step was carefully planned. Analytical 
capabilities were developed early on in the implementa- 
tion program. Goals and objectives were established 
and made integral components of the budget. A per- 
formance measurement system was set up to provide 
the information needed for program analysis. Support 
from Council and top management was strong and 
continuous. 


The PPB system seems to be firmly entrenched in 
Phoenix now. Goals and objectives are periodically re- 
vised and updated. The performance measurement sys- 
tem continues to evolve and improve. The analytical 
talents that have developed in the City are put to effec- 
tive use. The particular program structure chosen for 
Phoenix seems to suit the needs of the City. 


Thus Phoenix is a good example of a relatively success- 
ful implementation of Pps at the local government level. 


SAN DIEGO 


The City of San Diego, California, became involved 
with pps in 1973.7? Atthat time a special task force was 
set up to recommend a structure and measurement sys- 


21 The information in this and the succeeding paragraph has been 
taken from Charles E. Hill, Organizing for Productivity, pre- 
sented at the Annual Conference of the International City Man- 
agement Association, Seattle, Washington, September 29, 1975. 

22 See Performance Measurement Programs, San Diego, California, 
Appendix 11. 
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tem for the budgetary reform. The system chosen was 
more simple than is suggested by the PPB approach in 
that interdepartmental program structures, multi-year 
programs, financial plans and program alternatives 

were not included. The system was basically, therefore, 
a move to put the budget in program form. The essential 
components of the adopted system were as follows. 


1 Program Structure — improved delineation of prog- 
rams contributing to department’s basic objectives. 


2 Objectives — more specific and quantifiable state- 
ments of intended end-products or results of prog- 
rams. 


3 Output Measures — more meaningful measure- 
ments of program end-products or results. 


Thus the system involved the establishment of objec- 
tives, the setting up of programs to achieve those objec- 

tives and the determination of measures to act as indi- 
cators of achievement. 


The format of the budget process adopted included the 
traditional operating budget but it also displayed the 
following information: 


1 revenue by program and program element; 


2 long-range department goals and one year program 
and program element objectives; and 


3 summary of capital improvements program and 
cross-reference to operating budget. 


The following are illustrations of proposed program 
objectives and output measures for the city. 


Department Program Element Objective Output 
Building Structural Perform structural plan Number of structural plan 
Inspection Plan checks on 3,650 plans having checks (C)* 
Checking an estimated valuation of Valuation of plans checked (C) 
$295.4 million. Average time of plan processing (B) 
Fire Administration To lower fire cost. Fire cost per assessed valuation (B) 
To lower fire deaths and Fire deaths and injuries per capita (A) 
injuries. 
Fire To control and extinguish Average loss per fire by 
Suppression fires. occupancy (A) 
Average response time per fire (A) 
Equipment To insure availability of fire Number of times fire 
Maintenance apparatus and equipment as apparatus or equipment is 
needed. unavailable for service (A) 
Fire 5 To receive and interpret Average dispatch time (A) 
Communications request for emergency aid 
quickly and efficiently. 
Data Computer To operate the computer sys- Number of operator errors (A) 
Processing Operations tem with a minimum of errors. 
be Pipelines | To maintain pipelines, Cost per mile of pipeline 
tilities and Conduits conduits, and patrol roads. and conduit maintained (A) 
re and Reduce total number of Number of reported injuries (A) 
raining reported injuries by 5%. 
Pr t cleric inc ici 
operty Salen To increase efficiency Cost per unit of production (B) 
upport through a reduction in clerical 


costs per unit of production. 


* (A) Connotes Effectiveness Measure 
(B) Connotes Efficiency Measure 
(C) Connotes Basic Workload Measure 


Zero based budgeting (ZBB) 


Zero based budgeting is the most recent technique to be 
applied in budget reform. As with most new techniques 
the first organizations to adopt zBB were in the private 
sector. Consequently an example is given of the im- 
plementation of zBB in industry, in this case within 
Westinghouse Canada Ltd. 


WESTINGHOUSE CANADA LTD. 


Once the Westinghouse top management were commit- 
ted to zBB (Westinghouse prefers the term Zero-Base 
Planning) the company implemented the technique in 
earnest in July, 1976.28 Westinghouse’s interpretation 
involved the development of ‘decision packages’ by the 
different organizational units. The ‘decision packages’ 
involved the following. 


1 Package name — a description of the organization 
unit or program concerned 


Department — under which the unit falls 
3 Budget number 


Summary of decision package increments — out- 
lining changes expected in the upcoming period 
needing additional funds 


5 Statement of mission or purpose — 
Description of current operation — 


Planned method of accomplishing mission in the 
next period — 


8 List of alternatives considered and reasons for re- 
jecting — 

9 Incremental expense analysis — 

10 Prepared by — 


11 Approved by — 


Each of the increments discussed in this summary 
analysis (sections 4 and 9) is further outlined and 
ranked in an incremental analysis. 


This analysis is composed of the following sections. 


Package name 

Department 

Budget number 

Rank 

Description of output produced by this increment 
Description of benefits of this increment 
Consequences of not approving this increment 
Resources required 

Performance measurement 

10 Prepared by 

11 Approved by 


OONANAWN RK 


Once the vice-president for each of the different head- 
quarters has developed his decision package and rank- 
ings, these are reviewed by special task forces appointed 
by the company president. Each task force (one per 
headquarters VP) reviews these packages with the vp. 
The task forces are expected to make appropriate inputs 
relating to such things as: 


23 See Performance Measurement Programs, Westinghouse 
Canada, Ltd., Appendix 11. 


possible organizational changes; 
apparent overlaps and redundancies; 
decision package definition and priority; 


feasible alternatives which were not considered; 


na BW! Pp 


other approaches to providing the outputs of the 
budget centres being reviewed; and 


6 outputs which might be entirely eliminated. 


Each of these special groups is chaired by a vp from an 
operating department and outside consultants often sit 
on the team. The groups act as advisory bodies only and 
report to the vP in question. He still retains responsibil- 
ity for the deployment of resources. 


To help establish the program in the organization, Wes- 
tinghouse has designed a zero based planning manual 
organized around a 12 step description of the applica- 
tion of the system. Much of the success of the 
company’s ZBB effort has been the result of this care- 
fully planned process, the steps of which are outlined 
below. 


1 Clearly define the goals and objectives which the 
budget centre (in each department, division, etc.,) is 
supposed to support. 


2 Define the common assumptions which are to be 
used in the budget planning process. 


(Although certain assumptions, such as anticipated 
wage and salary increases, increases in costs of supplies, 
etc. are obvious, others, such as changes suggested by 
managers outside relevant divisions or departments, 
changes arising out of legislation or regulations, and 
changes due to broadly applied management decisions, 
are not so obvious, and an effort should be made to 
anticipate such changes if possible.) 


3 Define the mission or purpose of the organizational 
unit. 


(If the mission or purpose of the organizational unit 
cannot be described, questions should be raised about 
the effectiveness of that organizational unit.) 


4 List and analyze the department output. 


(What activities are performed, services provided or 
programs operated, in support of the department’s ob- 
jectives? What resources does it use and what does it 
produce?) 


5 For each project, work assignment and element in 
the organizational unit, ask the question: Should 
this be done next year? 


(One of the most difficult steps in the process. Someone 
closely associated with an activity or function for many 
years may find it difficult to view that activity with 
detachment. ) 


6 Consider carefully all feasible alternative ways of 
providing the outputs which survive the screening in 
step #5. 


(The most creative step in the process, this step is in- 
tended to counteract the tendency to view the way an 
output has always been provided as the only possible 
way to do the job.) 
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The preceding steps cover an in-depth analysis of the 
organization’s present position. The following steps 
represent the most critical aspect of zBB, the final pro- 
cess of prioritization and selection. These steps involve 
‘decision packages’ which are defined as discrete ac- 
tivities or outputs that can be influenced by manage- 
ment decisions. Decision packages provide the data 
base upon which all future decisions will be based. 


7 From the list of alternatives developed in step #6, 
select the one which will produce the required out- 
put with the greatest cost effectiveness. 


(This selected alternative forms the basis for developing 
a decision package. All other alternatives considered 
and rejected are summarized briefly in a report format.) 


8 Prepare a decision package incremental analysis 
based upon the minimum possible level of output 
and resources needed for the alternative chosen in 
#7. 

(The minimum level is defined as that level of output 

and effort below which the decision package ceases to 

be viable. The Westinghouse model states that the 
minimum package level should be developed at or 
below 70% of the actual level of expenditure except in 
very unusual circumstances. This procedure is intended 
to force the department manager to look at his decision 
package in a very stripped down configuration. This 
step, in effect, asks the manager to describe the 
minimum level of output and effort which would allow 
the operating unit to remain viable.) 


9 Prepare additional decision package incremental 
analyses describing discrete levels of output and 
resources. 


(Above the minimum level, as described in step #8, as 
many incremental levels may be described as is practi- 
cal. An increment must be a discrete element. It should 
not involve fractions of people, services or functions 

that cannot be isolated from other packages or levels.) 


10 Indicate recommended package level and have 
complete package approved by the superior. 


11 Rank all levels of all decision packages in descend- 
ing order of cost/benefit priority. 


(At each supervisory or management level where 
budgets are consolidated, the manager must combine 
and rank in descending order of attractiveness, all levels 
of all decision packages for which he is responsible. 
Ranking tables are prepared and later merged at each 
higher level where organizational components are 
brought together under the control of one manager.) 


12 Establish the funding level for department costs. 


(A consolidated ranking table, presenting a range of 
funding opportunities from zero to the cumulative total 
of all packages prepared, is submitted to top manage- 
ment (or the elected level) for final deliberation. Once 
the affordable funding level has been established, a cut 
off point on the ranking table is fixed. Packages above 
the line are funded; those below are deleted.) 


? ~e Pe : 
24 See Performance Measurement Programs, McMaster University 
> e) 
Appendix 1. 
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It should be apparent from the above that such a process 
needs strictly defined procedures and supporting mater- 
ial to succeed. A well thought out planning manual 
made acceptance of the approach a relatively simple 
matter in the Westinghouse system. 


McMASTER UNIVERSITY 


Anexample ofa non-industry application of ZBB is that 
of McMaster University of Hamilton, Ontario.?4 Simi- 
larly to municipalities, Canadian universities have suf- 
fered from the economic recession and are seeking ways 
of improving management efficiency. Up until 1975 
McMaster was using an incremental approach to 
budgeting but in that year the university decided to 
implement zero based budgeting. 


McMaster breaks the concept down into two distinct 
stages. 


1 The development of ‘decision components’. 


2 The ranking of these components. 


In the ‘development of decision components’ each man- 
ager is asked to analyze and describe the discrete ac- 
tivities, functions or operations within his department, 
that when isolated, have minimum impact on other 
departmental components. 


In order to determine the decision components in his 
area of responsibility each manager is asked to consider 
the following questions. 


1 What is the size of the organizational unit? Five to 
seven priorities per component Is average. 


2 Could the component be considered as warranting a 
separate set of accounts and budgets within the de- 
partment? 


3 Is it best to see some components as not being mutu- 
ally exclusive but as relating in a special way to other 
components? 


4 Will the task force have a clear understanding of the 
component’s function without being distracted by 
too much detail? 


Decision components are developed on four forms 
which are outlined as follows. 


Form #1 Decision Component Description 


This form provides all the data pertaining to each com- 
ponent required fora realistic evaluation of the need for 
funding that component. The descriptions for each 

component may include a statement of objectives, how 
the objectives will be achieved, the benefits expected, 
spending level and personnel requirements and the ef- 


fect on the unit and other unit operations of not funding 
the particular component. 


1 Decision component title and number 


2 Ranking number (From (1) essential — (6) not 
necessary for operations) 


Survey of manpower 
Objectives and descriptions of decision component 


Operational and/or legal considerations 
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Current methods of operation 


Volumes and workload 


8 Sources of input and direction of output of 
documents/data 


9 Benefits of operating the work unit 
10 Evaluation of the unit effectiveness 


11 Consequences of reduction or denial of funds 


Form #2 Alternatives 
1 alternative policies that should be considered; and 


2 alternative systems that should be considered. 


Form #3 Financial Detail 


On this form are identified the resources relating to the 
component under review. 


Form #4 Summary 


This form represents a summary of all the components 
within the entire department. 


The process then enters into the second stage, where the 
components are ranked according to priority. This 
stage involves first, a review by the senior line manage- 
ment. Department heads rank components in consulta- 
tion with Division heads. Second, the components are 
reviewed by a special task force of the President’s 
Budget Advisory Committee (PBAC). Eight task forces 
are set up to review designated areas of the university. 
Each of these task forces consolidates the priority rank- 
ings for all the units being reviewed and the pBac itself 
effects a university wide consolidation of all units. 


A financial ‘fit’ is then determined, with lower level 
priority units being identified for dissolution or winding 
down. 


C PROGRAM ORIENTED MEASURES 


The process of program measurement involves many of 
the measurement techniques so far discussed. Its pur- 
pose is to assess the effectiveness of programs to deter- 

mine if the program should be continued and, if so, how 
it should be improved. Consequently, it is a very broad 
process covering many aspects of the organization and 
how that organization relates to its environment. An 

example of how broad and comprehensive the process 
can be is given in the following twelve-step cycle sug- 

gested by one group concerned with program and pro- 

ject evaluation.?° 


Problem and needs analysis 
Formulation of goals 

Adoption of strategies and priorities 
Establishing programs 
Resource allocation 

Project funding 

Project performance 

Project monitoring and change 
Measuring project performance 
10 Program analysis 

11 Goals translation 

12 Internal redesign 


OOmANDAN AWN RK 


The following gives examples of program areas to 
which program evaluation may be applied. This par- 
ticular example refers to possible subjects of individual 


program evaluation and improvement in a Police 
Department. ”6 


Program evaluation 


Surveillance 


a Analternate mix of forces such as a major change 
in the composition of foot patrols vs. one-man 
police cars vs. two-man police cars vs. plain- 
clothes patrolmen vs. detectives, etc. 


b A neighbourhood policing program. 


c Reallocation of police by geographical location or 
time of day and day of week. 


d New communication devices. 
Fire Control 


a New firefighting procedures, equipment or vehi- 
cles. 


b New communication devices. 


c Reallocation of firemen and equipment by time of 
day or geographical location. 


Highway/Street Lighting 


a Newtypes or quantities of lighting in certain parts 
of the community (both in reducing crime and 
traffic accidents). 


Solid Waste Collection 
a New collection equipment. 


b New types of containers for refuse. 


Solid Waste Disposal and/or Water Treatment 
a New equipment or procedures. 
Recreation 


a New recreational programs, e.g., opening school 
grounds on weekends. 


b Selected existing programs and activities. 
Employment Programs 

a New types of training programs. 

b A new job generation and matching program. 
Transportation 

a Revised traffic control arrangements. 

b Revised public transit routings or new bus lanes. 

c New equipment. 
Health 


a Various drug abuse treatment programs. 


b Maternal and infant care clinic hours of operation 
or locational changes. 


c Special publicity campaigns for attracting persons 
to VD clinics or alteration of clinic location or 
hours of operation. 


An important component of program evaluation is the 
determination of goals and objectives for the program 
under consideration. Once these have been established 


25 80, pp. 10-11. 
26 Ibid. 


105 


their achievement becomes a measure of how effectively 
the program is being carried out. These measures, of 
course, should be supplemented with a type of effec- 
tiveness measure, client feedback, etc. These measures 
should help evaluate the goals and objectives. 


The following gives examples of program goals and 
objectives. In this case, the problem addressed is auto 
theft and the department concerned is a police depart- 
ment. The problems are outlined and the goals and 
objectives designed to approach these problems are 
given.?? 


1 Nature of Problems and Needs to be Met 


a The exposure to motor vehicle theft is increasing 
as shown by the growth of motor vehicle registra- 
tion: 1960 - 4,660,500; 1970 - 6,872,000, an 
increase of 47.45%. 


b Nearly 50,000 motor vehicles, boats and units of 
heavy equipment are stolen annually in this state 
with $35 million annual loss. 


c Motor vehicle thefts in the state increased from 
15,147 in 1960 to 39,110 in 1970, an increase of 
158% in 10 years. 


d Statewide clearance rates on motor vehicle theft 
have declined from 33% in 1967 to 24% in 1970. 


e Recovery rates have declined for the last several 
years, dropping from 94% in 1960 to 83% in 
1970. The recovery rate on motorcycles in 1971 
was only 39%. 


2 Goals and Objectives 


Project Goal: Reduce rate of motor vehicle theft by 5% 
over 1971; 


Specific Objectives: 
a Increase clearance rate on motor vehicle theft 
cases by 5% over 1971. 


b Improve statewide recovery rate by 3% over 
irae 


c Reduce number of motor vehicle theft cases refer- 
red to NATB by 5% over 1971. 


d Increase recovery rate on NATB referred cases by 
5% over 1971. 


Department Objectives: 


a Increase DPS arrests for motor vehicle theft and 
related offenses by 5% over 1971. 


b Increase DPS motor vehicle recovery rate by 5% 
over 1971. 


Non-quantified Project Objectives: 


a Improve reporting and investigative procedures at 
the state and local level, including the establish- 
ment of a reliable data bank. 

b Make trained auto theft investigators available to 


7 Ibid, pp. 25-27. 

See Performance Measurement Programs, Fairfax County, Vir- 
ginia, Appendix U1. 

29 See Performance Measurement, Government of the District of 
Columbia, Appendix 1. 


assist all law enforcement agencies hopefully re- 
sulting in more cases and better prosecution. 


c Create a closer liaison and better co-ordinated 
efforts among DPs divisions and services. 


d Secure legislation to combat vehicle thefts and 
successful prosecution, including salvage title 
laws on motor vehicles. 


e Initiate permanent identification stamping with 
dies on heavy equipment and boat motors. 


f Improve the co-ordination of all law enforcement 
agencies in connecting motor vehicle theft with 
other crimes and theft rings. 


Very few local governments have initiated a full prog- 
ram evaluation process, perhaps because it requires a 
considerable commitment on the part of the organiza- 
tion. Three municipalities that have attempted program 
measurement are Fairfax County, Virginia, the District 
of Columbia and the Region of Niagara, Ontario. 


FAIRFAX COUNTY, VIRGINIA 


One local government that has initiated program meas- 
urement particularly well is Fairfax County in 
Virginia. ?® 


In June, 1972, the county executive established a Man- 
agement Statistics Committee. The purpose of this 
committee was to develop a management indicator sys- 
tem that would help to determine the effectiveness of 
county programs and agencies and measure progress 
towards specific goals and objectives. 


The work program was divided into three major tasks: 


1 development of a series of goals and objectives for 
each county agency; 


2 development ofa series of management indicators or 
measures of effectiveness which reflect progress to- 
ward the achievement of goals and objectives. 


3 determination and evaluation of the needs and av- 
ailability of information in the county which would 
allow the reporting of the information identified as 
indicative of performance. 


Implementation of the program is the responsibility of 
the Office of Research and Statistics whose research 
analysts collect the data and analyze major deviations 
from targeted levels of performance. Every month, a 
comprehensive report, usually of more than 250 pages, is 
presented to the county executive (the time lag is about 
17 days) fully documenting the performance of the 
county and pointing out areas of concern. 


DISTRICT OF COLUMBIA 


On July 1, 1973, anew performance monitoring system 
commenced in the District of Columbia.2® The basic 

strategy of the Office of Budget and Financial Manage- 
ment (OBFM) in implementing the system contained six 


major steps. 
1 Agencies met with the oBrM to discuss performance 
monitoring plans and explored agency participation. 


2 oBrM briefed program managers on performance 
monitoring and performance criteria and perfor- 


mance measures were developed with agency assis- 
tance. 


3 Agencies and OBFM agreed on performance targets 
for appropriate measures. 


4 OBFM issued implementation instructions containing 
performance report forms and procedures to agen- 
cies participating in the system. 


5 Agencies implemented the system fully and began to 
collect and report program performance data. 


6 Other agencies not selected for initial participation 
were added to the system in accordance with a time 
phased plan. 


REGION OF NIAGARA 


An example of program measurement which stems di- 
rectly from the LGMp is that of the Day Care Program 
organized by the Homes for the Aged Department of the 
Ontario Region of Niagara, in 1975. The Lemp Team 
were able to assist almost from the start of this program. 
At the time the Team became involved, the Homes for 
Aged administrators had established that a need existed 
in the community for such a program. The Team as- 
sisted the program administrators to develop and 
clarify the purpose of the program, goals, objectives and 
indicators. This process helped in organizing the prog- 
ram in such a way that it could achieve its basic pur- 
poses. Through joint problem identification, problems 
such as ineffective reporting relationships, were iden- 
tified at the outset and the necessary adjustments were 
made. 


The goals that were established for the Day Care Prog- 
ram are as follows. 


Goals 


1 Tomake available an alternative to institutionalized 
care by providing preventative and supportive ser- 
vices to meet and maintain the individual needs of 
the senior citizens in the community for as long as 
physically and mentally possible. 


2 To restore self-esteem, where required, to the indi- 
viduals in the Program. 


3 To inform the community of what we are trying to 
accomplish with the Day Care Program. 


4 To make senior citizens aware of and make availa- 
ble to them information regarding all transportation 
facilities. 


5 To encourage the maximum degree of independent 


functioning in connection with community interests 
and activities. 


6 To liaise and co-operate with other departments in 
the Homes. 


7 To establish a self-sufficient Day Care Program 
within the community. 


8 Toconstantly review the Day Care Program in order 
to ensure that it meets the current needs of the daily 
participants. 


9 To arrange a sufficiently diversified program that it 
is able to meet the medical, nursing, recreational and 
social needs of the participants. 

10 To promote an environment conducive to job satis- 
faction. 


11 To provide the sound administrative and financial 
practices outlined in the Day Care Manual with the 
help of senior administrative staff, the program co- 
ordinator, the accounting department and the par- 
ticipants in the Program. 


Once these goals were established more specific objec- 
tives and performance levels were set. The tables over- 

leaf provide examples of objectives that flowed from the 
goals. Also included is an indication of the measures 

which were developed. 


Initially the program was reviewed every three months. 
After the program became established, however, less 
frequent reviews were needed. 


Although indicators were established to determine the 
degree of achievement of the objectives, the measures 
used to evaluate the program varied according to the 
level of responsibility and needs of the evaluator. Gen- 
eral measures not shown on the tables included: 


1 cost — day care is considerably less expensive than 
full time care. Consequently, the day care program 
saves money. This was a prime motivator and one of 
the main rationales for the program; 


2 numbers involved in the program — a key target was 
twenty people involved in the program at each 
Home, giving a total of 80 altogether; 


3 satisfaction of the people involved — the program 
was assessed on its ability to meet the needs of the 
users; and 


4 peer ratings —some of the individuals involved were 
influenced by the reaction of other municipalities to 
the program. If other municipalities were impressed, 
the program was rated highly. 
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Department: Homes for the Aged 


Division: Day Care Program 


Objective Statement Worksheet 


Goal Area Statement 


Objective Statement and Levels of Performance 
(Current and projected) 


Comments 
(Measuring device, 
comparable data, etc.) 


To inform the community 
of what we are trying to 
accomplish with the Day 
Care Program. 


To arrange a diversified 


enough program that would 


meet the medical, nursing, 
recreational and social 
needs of the participants. 


To constantly review the 


Day Care Program in order 


to ensure it meets the cur- 
rent needs of the partici- 
ants. 


To provide sound admini- 


strative and financial prac- 


tices outlined in the Day 
Care Manual with the 
senior administrative staff, 
program co-ordinator, 
accounting department 
and participants in the 
Program. 
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Contact Service Clubs, Clergy and 0.M.A. 


Schedule for: 


(1) letters to service clubs by November 14; 


letters for church bulletins by Nov. 7; literature 
for posting by physicians by Nov. 7; contact 


branch of 0.M.A. by Nov. 7. 


(2) Contact general public 
— poster in City Hall by Oct. 31. 
— poster in shopping malls by Oct. 31. 
— poster in pharmacies by Oct. 31. 


— ask Chamber of Commerce to have stores 


leave signs up permanently. 


(1) Ask residents for input concerning the 
program of activities. 
— meet with residents every two weeks to 


gather opinions, criticisms, likes and dis- 


likes. 


(2) Schedule active and passive activities on an 
alternate basis to involve all residents. 
— bowling followed by lunch 
— wake-up workshop followed by crafts. 


(1) Complete resident assessment sheets. every 15 


days. 


— investigate changes in residents 
immediately. 


WN 


Letters to those who have not pursued the 

issue beyond completing the application. 

— find out why they stopped completion 
of the application. 


Review procedures and maintain what is outlined in 


Manual. 


How many referrals 
from each group and 
how many inquiries? 


Judging by number of 
referrals and inquiries, is 
this as effective a 
method of recruiting as 
the contact with target 
groups in #1? 


How many participate? 


How often? 


How long? 


How many who did not 
respond to verbal 
inquiries answer the 
letter? 


Do any come to the 
program? 

Is undesirable behaviour 
or reaction dispelled? 


Is the program opera- 
ting within its budget? 


Objective Statement and Levels of Performance 
(Current and projected) 


Goal Area Statement 


Comments (cont'd) 
(Measuring device, 
comparable data, etc.) 


To encourage the 
maximum degree of 


Maintain ongoing awareness of activities in 
community that may interest residents. 


Do any residents go to 
these functions on their 


independent functioning in — attend a Christmas bazaar at local church own? 


connection with community 


interests and activities. lounge. 


— keep social calendar for Welland posted in pD.c. 


Do they want to go as a 
group to these 
activities? 


D MANAGEMENT PROCESS ORIENTED MEAS- 
URES 


The Local Government Project concentrated primarily 
on management processes and activities. The LGMP 
Team believed that the best approach to management 
improvement was through management procedures 
and processes. Perhaps the best measure of these inter- 
nal systems is to ensure that they meet the needs of the 
user and are in the best interests of the tax-payer. Goals 
and objectives were employed extensively by the LGMP. 
The explicit statement of purpose and intention, and 
measures for programs and internal systems are ideal 
for ensuring that the work is co-ordinated and carried 
out efficiently and effectively, irrespective of whether 
the department concerned is a support department or a 
line department. The following examples give some 
appreciation of the process content of goals and objec- 
tives in a support department and two line departments. 
In addition, some examples of process oriented objec- 
tives of individual managers are included. Finally, a 
brief description of LGMP experiments and progress 
with measurement in the four Project Municipalities is 
given. 


1 Support department goals and objectives 


The following example represents support department 
goals and objectives. In this case, they apply to a Fi- 
nance Department in one of the four Project Munici- 
palities. First, the departmental goals are given in order 
of priority. The department is then broken down by 
areas of responsibility, programs within these areas are 
identified and the goal and objectives are established for 
each program. 


FINANCE DEPARTMENT GOALS 

Priority 

1 To meet and consult more regularly with the user 
departments, with the objective of better defining 
their management and financial information needs, 


leading to the development and use of a more relev- 
ant and timely financial information system. 


2 To explore alternatives in purchasing methods and 
procedures to permit more flexibility and user de- 
partment acceptance, to be accomplished within a 
centrally co-ordinated system. 


3 To identify E.D.P. user department requests for 
program changes and prepare a submission to the 
Data Processing Management Committee for con- 
sideration and establishment of overall priorities. 


4 To participate fully in a computer feasibility study 
to assist the user departments to define and meet 
their management information system needs 
through an effectively updated five year plan. 


5 To develop organizational administrative proce- 
dures to ensure a continuity of approach, strengthen 
internal control methods and complement staff 
training efforts. 


6 To review the payroll system to satisfy the need for 
an improved E.D.P. approach that will eliminate the 
present onerous manual tasks and the many excep- 
tions to the present basic system. 


7 To develop a relevant account coding structure to 
allow input data to be pertinent to the needs of user 
department management and to outside reporting 
agencies. 


8 To trace and document the need for and use made 
of user department requests for budget-to-actual 
financial information. 


9 To review the allocation and use of staff resources 
within the department with the objective of improv- 
ing work orientation, employee morale, workload 
distribution and to better identify staff interrela- 
tionships and work progress efforts. 


10 To provide senior police management with man- 
power allocation and crime data in a report format 
which will provide the basis for improved resource 
allocation. 
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Finance Department Goals and Program Objectives for 1977 


Specific 
Programs 


General 
Responsibilities 


Program Goal 


Program Objectives for 1977 
over and above the regular 
duties required in each 
program 


Advisory Service to 
Council, Standing 
Committees and other 
Departments 


Administration 


Department Administra- 
tion 


Staff Development 


Intergovernmental 
Affairs 
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To develop policy and pro- 
cedural alternatives as input 
to decision making by both 
elected and appointed officials, 
with regard to the general 
operation of the municipality 
and its financial management 
in particular. 


To maintain Finance De- 
partment performance at the 
highest level through a pro- 
cess of goal setting, perfor- 
mance appraisal, review, and 
the measurement of achieve- 
ment towards predetermined 
targets. 


To provide adequately trained 
staff to meet present and 
future requirements through 
an ongoing process of recruit- 
ment, in-house training and 
job enrichment. 


To maintain the capacity to 
assess changing intergovern- 
mental relationships and 
advise on policy re such 
changes. 


i To develop written pro- 
cedures and policies in 
the areas of purchasing, 
budgeting and cash 
management. 


ii To increase Finance De- 
partment attendance at all 
standing committee meet- 
ings to increase awareness 
of municipal problems and 
projects. 


i To develop performance 
measures for each Finance 
Department Program. 


ii Complete development of 
Central Filing System. 


Interview all management 
staff quarterly and all other 
staff annually. 


—- 


ul 


iv To eliminate file storage 
problems using microfilm- 


ing. 


v To complete renovations 
of Finance Department 
Office. 


i To hold at least four in- 
house training sessions for 
Finance Department staff. 


ii To update all job descrip- 
tions. 


i To develop input to the 
Finance Report of the 
Commission. 


ii To finalize input to the 
Commission on 
Reassessment. 


iii To participate in the 
A.M.O. Board of 
Directors-Resolutions 
Committee. 


Finance Department Goals and Program Objectives for 1977 (cont'd) 


General 
Responsibilities 


Specific 
Programs 


Program Goal 


Program Objectives for 1977 
over and above the regular 
duties required in each 
program 


Financial 
Stewardship 


Preparation of Financial 
Statements — Monthly, 
Annually, Subsidy 
Claims, etc. 


Processing of Payroll 


Processing of Accounts 
Payable 


Cash Management 


To develop and maintain a 
financial information system 
for operating departments, 
senior management and 
Council which will also 
accommodate the preparation 
of subsidy claims and financial 
reports on a timely basis. 


To process all municipal 
payrolls in accordance with 
contractual obligations. 


To process all accounts for 
payment in a manner which 
will ensure the accuracy, 
proper authorization and 
accounting for such payments 
after verification of the receipt 
of the goods and services 
ordered. 


To ensure the investment of 
all surplus funds and the ob- 
taining of required temporary 
borrowing at the most effect- 
ive rates subject to any legal 
restrictions. 


1 To hold bi-monthly meet- 
ings with operating de- 
partments to improve 
interdepartmental com- 
munications and inform- 
tion flow. 


i Finalize accounting sys- 
tem for water and sewage. 


To develop in-house back- 
up staff for Chief Account- 
ant’s position. 


jet 


ul 


iv To investigate operating 
reports from January 
onward. 


i Monitor new payroll 
system to ensure effective 
operation. 


it Develop manpower 
reports from new system. 


1 Development of a 
‘commitment system’ for 
P.O.’s in conjuction with 
development of a 
Financial Core System. 


i Identify processing time of 
invoice and improve 
where appropriate. 


i Development of written 


procedures to cover all 
borrowing and investing of 


funds. 


i Introduction of a perfor- 
mance measurement 
based on “Standard Cost” 
principles. 


ii Introduce new borrowing 
by-laws. 
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Finance Department Goals and Program Objectives for 1977 (cont'd) 


Specific 
Programs 


General 
Responsibilities 


Program Goal 


Program Objectives for 1977 
over and above the regular 
duties required in each 
program 


Preparation of Capital 
and Current Budget 


Budgets 


Preparation of Capital 
Budget Performance 
Reports 


Current Budget 
Performance 
Reports 


Provision of Data Pro- 
cessing Facilities 


Management 
Services 


Analysis of Systems and 
Equipment Needs 


To develop a system of capital 
and current budgeting which 
will reflect in an understand- 
able way the allocation of 
financial resources to munici- 
pal programs based on estab- 
lished policy and priorities 
and which will indicate the 
sources of funds required to 
support the approval 
expenditures. 


To develop and maintain a 
reporting system for Capital 
Works Projects which, on a 
timely basis, will give data on 
project progress, cash flow, 
subsidies carried, expendi- 
tures and commitments and 
ensure adequate project 
financing. 


To develop current budget 
performance reports which 
will monitor budget perfor- 
mance, highlight budget var- 
lances and identify surplus 
funds for reallocation where 
required, as determined by 
Council. 


To provide required data pro- 
cessing capacity through the 
arrangement with the City of 
—for the processing of 
financial data. 


To provide expertise within 
the municipality in systems 
analysis, programming 

and equipment needs. 


1 


i 


il 


Identify ‘programs’ in all 
operating departments and 
recast 1977 approved 
budget on Program lines. 


Develop budget presenta- 
tion format for current and 
capital budgets for use in 
1978. 


Introduce a system for 
accounting for capital 
projects which will 
facilitate financial control 
and reporting. 


Develop a policy for gov- 
erning the method of 
changing the budget that 
increase budget admin- 
istration flexibility while 
maintaining policy control 
at the elected level. 


Work with the City of—in 
reviewing and assessing 
future equipment needs. 


Review job descriptions of 
b.p. Manager and 
systems/analyst. 


Analyse operation of 
Homes for the Aged to 
assess needs for 
introduction of E.D.P. 
application and improved 
information flow. 


Develop programming for 
‘Financial Core’ system. 


Finance Department Goals and Program Objectives for 1977  (cont’d) 


Program Objectives for 1977 
over and above the regular 


General Specific duties required in each 
Responsibilities Programs Program Goal program 
Management Development of new To provide expertise within i To develop a new chart of 
Services Financial Management the municipality to research, accounts as a basis for a 
(cont'd) Systems develop and implement, finan- comprehensive ‘Financial 
cial management techniques Core’ system which will 
designed to improve the over- include the complete 
all efficiency and effective- mechanization of the 
ness of the municipality. accounting system in 1978. 
it To develop Debt 
Registration Program. 

1 To review and develop a 
new system of equipment 
replacement financing. 

Insurance To review and manage all 1 Review fidelity insurance 
municipal insurance including amounts. 
the updating of asset 
valuations. 
Control Processing of Purchasing To procure all goods and ser- i Development of a purchas- 
Purchasing Requisitions, Expediting, vices required by the munici- ing procedural by-law. 


Quotations and Tenders 


Refinement of Central 
Purchasing Techniques 


Surplus Assets 


pality at the lowest cost com- 
patible with quality and deliv- 
ery time and particular em- 
phasis on the use of bulk 
purchasing. 


To develop and maintain ex- 
pertise on market conditions 
and produce innovations with 
regard to such goods and ser- 
vices required by the munici- 
pality and to advise all 
departments accordingly. 


To maximize the return from 
or reuse of assets declared as 
surplus, obsolete or scrap. 


ii Determine performance 
measurement for purchas- 
ing activities. 


Reduce turn around time 
for issue of P.O.’s by —%. 


—s 


il 


iv Improve expediting of 
CORES 


i Develop and maintain a 
comprehensive list of 
prices for classes of goods 
used in the municipality, 
for use in budgeting. 


ii Initiate regular meetings 
with Public Works/Social 
Services similar to those 
with Homes. 


i Hold three major and three 
minor police auctions. 


ii Obtain adequate storage 
facilities and dispose of all 
‘scrap’ and worthless 
‘assets’. 
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Finance Department Goals and Program Objectives for 1977 (cont'd) 


General 
Responsibilities 


Specific 
Programs 


Program Goal 


Program Objectives for 1977 
over and above the regular 
duties required in each 
program 


Long Term Approval of Capital Works 


Debt 


Issuing of Long Term Debt 


Debenture Registration 


Tile Drainage-Shoreline 
Prop. Debentures 


To obtain all required Ontario 
Municipal Board approvals 
and to monitor and advise 
Council on the initiation of 
capital works by the munici- 
pality as to the availability of 
funds. 


To have a continuing program 
of issuing long term debt to 
meet the financing require- 
ments of the municipality at 
the lowest possible costs 
consistent with market 
conditions. 


To maintain records of all de- 
bentures issued to the public 
which are registered to 
Principal and Interest or 
Principal only. 


To process applications from 
area municipalities for the 
issue of debentures for the 
purpose of the Tile Drainage 
Act and the Shoreline 
Properties Act. 


i Develop a system for 
measuring debt capacity in 
the municipality. 


i Develop material for use in 


application for a ‘credit 
rating’ and to present 
such information to 
Moody’s by June, 1977. 


i Develop and initiate com- 


puter program for record- 
ing all registered deben- 
ture owners and issuing all 
interest cheques. 


i To train the accountant I 


to handle all aspects of this 
program. 


Apart from the breakdown given in this example of 

departmental goals and defined responsiblity areas, the 
department is broken down into different functional 

groupings. These include Accounting, Purchasing, Data 
Processing, Budgeting and Long-Term Debt. Each of 
these has its own goals and objectives which tie into the 
departmental goals and objectives. 


As can be seen by this example the Finance Department 
in this case has a clear understanding of its role and 
responsibilities within the corporate structure. This 
type of definition was frequently found to be lacking in 
the case of support departments in local government. 
2 Line department goals and objectives 

The establishment of meaningful goals and objectives 
that indicate direction, identify problem areas, work 
overlaps, etc., is not always a simple and straightfor- 
ward task. The LGMpP Team found that in some cases, 
when departmental managers are requested to consider 
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their departmental goals and objectives they merely 
listed the activities that were ongoing or gave a vague 
description of responsibilities. 


The following example is one such attempt by a Plan- 
ning Department manager. In this case, the task of 

establishing objectives was seen to be unrelated to his 
work; it was perhaps seen as a threat, to be pushed out 


of the way as quickly as possible with minimum effort 
and commitment. 


PLANNING DEPARTMENT 
Primary Role 


To advise the Council on matters related to the use of 
land and its effects. 


Main Goals 


1 To advise Council on the goals of the municipality 
and their revision. 


2 To advise Council on the means ofimplementing the 
municipality’s goals on a priority system. 


3 To co-ordinate with other municipal and local de- 
partments. 


4 To co-ordinate the advancement of the municipal 
community with higher levels of government. 


5 Tocreate public involvement in and awareness of the 
use of land and its effects. 


6 To develop and encourage an awareness among all 
planning staff of the activities and goals of the de- 
partment and offer the opportunity for input. 


7 To improve the efficiency and effectiveness of the 
department. 


After the LGMP Project Director and the municipal Pro- 
ject Leader talked with the Department Manager about 
the function of the Department, where it fitted into the 
organization, what its resources were and how it could 
display these resources to the best advantage, the Man- 
ager decided to re-write the departmental purpose and 

goals and to use the process to communicate to other 

departments and to council regarding the role the de- 
partment management felt it should play. The revised 

purpose and goals are as follows. 


Revised Primary Roles 


1 To advise Council on the management (develop- 
ment, conservation, protection) of the municipal re- 
sources (land, air, water, and finances) as they relate 
to the delivery of services and the enhancement of the 
quality of life. 


2 To advise Council on the relationships and inter- 
relationships of social (people), economic (finances) 
and physical (land) matters as they relate to the 
municipality and its management. 


Main Goals 


1 To advise Council on the preparation, adoption, 
revision, and distribution of a statement of goals and 
objectives and those policies required to achieve 
them for the municipality. 


2 To advise the municipal Council on means of imple- 
menting the municipality’s goals through policies 
and objectives on a priority basis. 


3 To provide for the advancement and improvement of 
the community through the co-ordination of goals 
and policies of other municipal and local depart- 
ments and other levels of government, and to prom- 
ote and provide mutual understanding and assis- 
tance in the implementation of various programs. 


4 To link financial policies with the goals for the com- 
munity. 


5S To obtain and provide information to other depart- 
ments, local governments, other government agen- 
cies, and the public to aid in the understanding, 
improvement, and achievement of municipal goals. 


6 To provide information to the general public to en- 
courage their knowledge about the use and regula- 
tion of land and their involvement in the future of the 
community. 


7 To assist developers, builders and other persons in- 
volved in the planning and development field with 
improved information. 


8 To develop communications among all the planning 
staff about the goals and activities of the department, 
in order to stimulate input, interest, and a creative 
working environment. 


9 To develop an optimum level of efficiency and effec- 
tiveness for the department. 


As can be seen, these goals are considerably stronger 
than the first attempt. The first attempt produced rela- 
tively wishy-washy, non action-oriented goals, while in 
the second attempt the goals are far-reaching, manage- 
ment oriented, operational and reflect a commitment to 
action. Through this process the Planning Department 
established itself as having a strong and valuable role 
and a strong sense of identity and direction in the or- 
ganization. Meaningful objectives could then be written 
which were genuinely a part of the ongoing manage- 
ment process rather than being something to be done 
and pushed aside as being irrelevant or non- 
operational. 


DEVELOPMENT DIVISION — ENGINEERING DEPARTMENT 


The LGMp Team was fortunate enough to have the 
opportunity to assist a division that had been newly 
formed and was having some difficulty establishing 
itself and devising processes to meet its responsibilities. 
In this case a new Development Division of an Engineer- 
ing Department had been formed to consolidate the 
work of two divisions and to perform a number of 
entirely new functions. The staff for the new division 
were drawn from the former two divisions. Difficulties 
arose because the staff tended to retain their former 
work habits and orientation and did not incorporate the 
new functions. The LGMP Team spent some time with 
this division identifying such aspects as: 


1 those activities that the division should be involved 
in; 

2 those activities that were not being accomplished; 
and 


3 the drawbacks associated with the present activities 
and processes, etc. 


Again, a process beginning with clarification of purpose 
and clearly defined goals and objectives was found to be 
a most useful approach. During its establishment, many 
areas of overlap and areas where gaps existed were 
identified and objectives were set to overcome the prob- 
lems. It was also found that anumber of the departmen- 
tal processes in operation were unnecessarily long and 
complicated. 


In this case, the goals and objectives that were estab- 
lished helped to give the division direction and to co- 
ordinate the work in the department so that all func- 
tions were handled well and in the proper order. It was 
believed that the work of this division could be co- 

ordinated with the work of others and the team effort 
helped to establish a cohesiveness in the division. Pro- 
cesses and procedures were redesigned to accomplish 
the divisional purpose as efficiently and effectively as 
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possible. As a result manpower needs were better un- 6 Toensure staff capability of meeting the goals of the 


derstood and the resulting analysis helped in presenting division. 

the case for more staff to council. The following repres- 7 To provide effective liaison with appropriate indi- 
ents the most recent function and goals statement for vidual and seence™ 

oe er 8 To develop and administer guidelines and proce- 
Development Division Function dures for the engineering approval of the extension 
To develop, evaluate and modify public works prog- of local works or connection of local works to a 
rams that will ensure the provision of public works municipal water or sewer facility. 

facilities to meet community needs within the limits of 9 To develop a capability to recommend the role of 
available financial resources. the municipality in waste management and resource 
aa recovery. 


10 To initiate and co-ordinate the municipal transpor- 
tation planning process so that transportation 
facilities are systematically tested as to present and 
future adequacy, and to develop a program for im- 
plementation, scheduling and financing transporta- 

3 To develop strategies that will include priorities and tion facilities within the framework of the municipal 
funding resulting in optimization of public works Policy Plan to meet present and future needs. 
facilities required. 


1 To identify community needs for municipal public 
works facilities. 

2 To determine the availability of financial resources 
to provide the required public works facilities. 


When these goals had been established, operational ob- 


4 To evaluate development proposals to determine jectives were drawn up. The following are general and 
conformance with respect to public works more detailed objective statements for the first four 
strategies. goals. The detailed objectives could be categorized as 

5 To modify strategies such that the provision of pub- action statements, many of which concern internal 
lic works facilities is in conformance with commun- work flows, processes and procedures. 


ity needs. 


Objective Statements 


General Objective Statement Detailed Objective Statement 


Goal 1 To identify the community needs for municipal public works facilities. 


1 Review established urban area boundaries (UAB). a Determine servicing requirements in U.A.B. 
Determine deficiencies within U.A.B. 


c Assign and establish priority in liaison with Planning 
Department for servicing within U.A.B. 


d Develop a program to service U.A.B. 
e Develop program to clear deficiences in U.A.B. 


f Assign personnel to above. 


2 Review and catalogue existing municipal public a Determine what should be catalogued (i.e. pipe size, 
works facilities. slope, etc.). 


b Prioritize what has to be catalogued. 


c Establish a method of data processing and retrieval. 


3 Review community servicing needs outside 


Identification of communities outside the U.A.B. 
of urban boundaries. 


ao 


Evaluation of their needs. 


c Determine if deficiences exist. 


Q. 


Establishment of prioritized programs in liaison with 

Planning Department to correct servicing deficiencies. 
e Assign personnel. 
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Objective Statements (cont'd) 


General Objective Statement Detailed Objective Statement 


4 Review need for municipal participation in provision a Complete transit study. 


of transit services. Determine (from study) the role of the municipality 
now. 


c Determine (from study) the role of the municipality’s 
future. 


5 Review need for municipal participation in a Complete the municipal waste management study. 
ee ee ent. b Determine the role of the municipality now. 


c Determine the role of the municipality’s future. 


6 Review need for municipal participation of additional a This objective becomes apparent when Goal 1 
water and sewer servicing responsibilities. Objectives 1, 2 and 3 are accomplished. 


Goal 2 To determine the availability of financial resources to provide the required public works facilities. 


1 Review, catalogue and evaluate federal financial a Identify all programs available. 
ae eA Pt Osrams. Establish an inventory of available programs. 


c Evaluate financial programs available to the 
municipality. 


d Prepare recommendations for changes to make use 


of funds. 
e Establish a system to update inventory. 


Assign a body. 


2 Review, catalogue and evaluate provincial financial a Identify all programs available. 
Ce Aue prog ralns. b Establish an inventory of available programs. 
c Evaluate financial programs available to the 
municipality. 


d Prepare recommendations for changes to 
make use of funds. 


e Establish a system to update inventory. 


f Assign a body. 


3 Review and catalogue historical financial records. a Acquire information — budgets and actual 
expenditures. 


b Catalogue expenditures (actual). 
c Evaluate data. 
d Determine trends. 


e Evaluate cost/benefit to Region, analysis of 
expenditures vs. returns. 


i 


Objective Statements 


General Objective Statement 


Detailed Objective Statement 


4 Review and catalogue historical cost sharing 
programs with area municipalities. 


5 Review and catalogue historical cost sharing 
agreement with the private sector. 


oO feat 9 Le) a © 
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Identify projects. 

Catalogue projects. 

Evaluate whether municipality actually benefited. 
Recommend action. 

Formulate policy. 


Establish system to update information and catalogue. 


Identify projects. 

Catalogue projects. 

Evaluate whether municipality actually benefited. 
Recommend action. 

Formulate policy. 


Establish system to update information and catalogue. 


Goal 3 To develop strategies that will include priorities and funding, resulting in optimization of public works facilities 


required. 


1 Undertake a transportation planning review of the 
municipality that will provide recommendations on 
the provision of all transportation facilities to accom- 
modate projected land use within the municipality. 


2 Develop policies that will ensure optimization of all 
existing transportation facilities. 


3 Update transportation component of the Municipal 
Official Plan. 
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To acquire land use traffic data for the model. 
To develop computerized transportation models. 


To estimate future transportation demands on the 
road network use in alternative land use concepts. 


To establish in-house staff capabilities to re-evaluate 
input data as refinements in input occur. 


Identify problem areas. 
Acquire data necessary for policy formulation. 
Review existing practices and procedures. 


Prepare road classification policy consistent with 
future and present needs. 


Prepare right-of-way widths. 
Prepare setback and encroachment policies. 


Update of the above policies to be done, when 
objective 1 (c) of Goal 3 is accomplished. 


To be completed. 


Objective Statements 


General Objective Statement 


(cont'd) 


Detailed Objective Statement 


Goal 4 To evaluate development proposals to determine conformance with respect to public works strategies. 


1 To deal effectively with development proposals from 
the private sector and area municipalities and to 
recommend appropriate action to Engineering 
Committee. 


2 To deal effectively with sewer and water construction 
proposals by the private sector and area municipalities 
and recommend appropriate action to the Engineering 
Committee. 


3 Review and evaluate current Engineering Department 
construction programs and operating performance. 


a To develop a flow chart analysis of all incoming 
development proposals. 


b To develop a system of collecting and evaluating 
existing data. 


c Preparation of report to Engineering Committee. 


Follow up to the appropriate agency and individual. 


a Develop flow chart analysis of all incoming water and 
sewer construction projects. 


b Develop a system of collecting and evaluating existing 
data. 


Preparation of report to Engineering Committee. 


d Follow up to the appropriate agency and individual. 


a Purpose of this objective is to update data on servicing 
capabilities. 


b This objective is accomplished when objectives 
1, 2 and 3 of Goal 1 are attained. 


PROJECTS DIVISION — ENGINEERING DEPARTMENT 


Another example of the use of goals and objectives for 
process oriented measures was that of the Projects Divi- 
sion of an Engineering Department. In this case, the 
output was not as efficient as the people involved 
thought it might be. The problem it seemed was internal 
to the division. 


The staff of this division was composed of equal num- 
bers of professional engineers and semi-professional 
engineers. The relationships between these two groups 
was somewhat indistinct. There was no defined role for 
the superiors when working on any particular job; the 
roles and responsibilities of professionals and semi- 
professionals could differ across jobs or with particular 
professionals. Although the staff were on friendly terms, 
the communication channels were not well established 
and exploited. As a result of the poor communication 
and role and responsibility confusion, mistakes and 
errors were made, and work was overlooked because 
individuals assumed that it was some other person’s 
responsibility. 


The tGMpP Team held a full day organizational review 
with the staff, discussing reporting relationships and 


providing an opportunity for conflicts and problems to 
be aired. It was encouraging to find that although the 
current process did not emphasize or require a great 

deal of co-ordination, the staff took great pride in their 
work and wanted to work together as a cohesive unit to 
create the best division in the Department. 


As a result of this review,, the reporting relationships 
were modified, the workload was distributed more 
equitably, the communication channels were estab- 
lished, and the internal processes were geared to meet 
the needs of the staff. 


In this case, therefore, the problem was defined as being 
an internal process problem and goals and objectives 
were used as a means to overcome that internal prob- 
lem. Goals and objectives were not used as a planning 
tool or for program evaluation because all the work in 
this case was predetermined. Instead, goals and objec- 
tives were used to define the problems and improve the 
internal processes associated with work assignment. 


The completed divisional goals and associated objec- 
tives were as follows. Note the large number of objec- 
tives which deal with the improvement of processes. 


i 


Goal 


Objectives 


1 To provide engineering, administration and construc- 
tion services for public works projects to ensure con- 
formance with accepted engineering standards, 
municipal policies and approved financial allocations. 


2 To report on property matters, negotiate acquisition 


of easements and out-right purchases to accommodate 


public works facilities. 


3 To provide meaningful planning input and liaison to 
all appropriate agencies toward the planning and 
development of municipal capital works. 


4 To provide and undertake periodical review of 
organization for the Projects Division, that will 
facilitate the accomplishment of assigned tasks. 
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a In-house engineering to be completed within the fiscal 
period and sufficiently in advance of the length of time 
necessary to undertake the construction. Performance 
would be measured on an individual basis as com- 
pared with work that would be performed in the pri- 
vate sector. 


b Administration of all projects by Projects Division 
also to be monitored on an individual project basis 
and performance to be evaluated on how smoothly all 
facets of the development of the work is progressing. 


c Actual construction to be monitored again on an 
individual basis and compared to: 


i allocation provided; 


ii number of claims which have been dealt with 
and amount of cost; 


ili comparison of the work to previous similar 
undertakings, and 


iv requested input from operating division as 
to the adequacy of the completed work. 


a Property acquisition to be monitored in terms of com- 
pliance with deadlines for construction purposes and 
the success of mutual negotiations of property with 
individuals or other municipalities. 


b The adequacy of property records will be determined 
by their availability for reference purposes, working 
toward a minimum of staff time to locate information 
and also their ability to provide the particular 
information required. 


a Planning input to be provided by Projects Division on 
the basis of their experience in undertaking current 
construction projects, particularly with regard to 
committed capital costs and necessary carry-over into 
the subsequent fiscal period. Such planning input to be 
measured in terms of ensuring that sufficient response 
is given to enable successful programs within capital 
budgets to be easily developed, particularly as they 
relate to the two to three year minimum future 
requirements. 


a Review of division organization to be undertaken on 
an annual basis which will monitor the success or lack 
of success of achieving the work output and also com- 
pare the costs of providing this service in relation to 
similar agencies or to the private sector. 


Goal 


Objectives (cont'd) 


5 To investigate the availability and make optimum use 
of funds from other agencies. 


6 To improve co-operation, communication and co- 
ordination between the Projects Division and 
municipal departments. 


7 To continually develop the human resources within 
the Division. 


8 To develop the priorities and scheduling of tender calls 
and preparatory work. 


a Continuing review of legislation and trade papers and 
journals to identify whether other governmental 
authorities are proposing new programs which may 
offer additional funding. This to be a continuous 
surveillance with periodic checks with other similar 
municipal organizations as to their experience. 


b Existing funding programs to be scrutinized to ob- 
tain maximum eligibility and total utilization of funds. 


The improvement of co-operation and co-ordination 
with municipal departments to be achieved by: 


a securing the response of the municipal departments 
concerning imminent projects which allow sufficient 
lead time for follow-up by affected parties; 


b distribution of construction drawings and 
specifications; and 


c invitations to municipal departments to attend 
pre-construction and site meetings of construction 
projects. 


Evaluation of performance to be on basis of reduction in 
complaints and general response of the municipal 
departments on future work. 


a Development of human resources to be undertaken 


by: 
i training programs; and 
ii improvement in communications. 


b Annual review of performance of staff members and 
individual discussion with each, to advise of both 
satisfactory performance and those areas requiring 
improvement. 


a The development of priorities shall be on a continuous 
basis with formal documentation on perhaps a bi- 
monthly basis. The establishment of priorities for Pro- 
jects Division work will be dependent on a large 
number of factors: the co-ordination of property ac- 
quisition, if required; the need to co-ordinate work 
with that of other agencies or to ensure co-ordination 
with other construction; the anticipation of the 
amount of lead time necessary to undertake engineer- 
ing; and also the need to secure the various approvals. 
All of these will establish priorities. The success 
of the priorities so established, to be measured by 
the response of the user division or department, the 
Engineering and Utilities Committee, and the 
public. 
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Goal 


Objectives 


(cont'd) 


8 To develop the priorities and scheduling of tender calls 


and preparatory work. (cont'd) 


9 To develop and periodically review standards and 
operating policies for all municipal servicing. 


b The scheduling of tender calls to be developed also on 


a continuous basis, taking into consideration the 
weather conditions which may affect construction 
work and costs, the volume of available work to con- 
tractors, the setting of tender openings to avoid con- 
fliction with similar works, and also the recog- 
nition that municipal tender calls should be separ- 
ated to ensure a maximum response from local 
contractors. 


Review and update standard construction details and 
specifications on an annual basis to eliminate pro- 
blems occasioned by increased costs and/or 
additional claims during construction. 


Operating policies should be reviewed on a bi-annual 
basis and measured on whether such policies have 


provided the level of service and achieved the 
particular purpose for which such policies were 
developed. 


Apart from helping to develop divisional goals and 
objectives, each engineer and supervisor developed goals 
and objectives for his own operation. For instance, the 
Design and Construction Engineers’ goals were as fol- 
lows. 


Design and Construction Engineer — Goals 

1 To direct engineering technologists and technicians, 
draftsmen and surveyors in the execution of en- 
gineering and construction projects. 

2 To liaise with consulting engineers in reviewing de- 
sign, contract drawings and specifications. 

3 To secure necessary approvals for projects from the 
Ministry and other authorities involved. 

4 To prepare reports and data for submission to 
Committee and Council. 


5S To review designs, proposals and reports by other 
authorities affecting municipal facilities. 

6 To review and approve engineering and construc- 
tlon accounts. 
To establish the terms of reference of each project. 
To attend interim meetings with consultants to re- 
view progress. 

9 To hire personnel, i.e. review of job applications and 
interviewing of candidates. 

10 To provide effective and efficient engineering, con- 
tract administration and project cost control. 
Similarly the Property Supervisor’s goals were as fol- 

lows. 
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Property Supervisor — Goals 


1 To develop and update data on all municipal prop- 
erty, especially the municipal road network, for use 
in co-operation with other municipal departments. 


To develop and update a land value data bank. 


3 To provide the most effective and efficient use of 
staff and monetary resources available. 


4 Toundertake in-house appraisals and administer the 
appraising of properties for municipal projects. 


5 To undertake in-house legal surveys and administer 
the legal surveying of properties for municipal pro- 
fects: 


6 To negotiate municipal property transactions with 
private owners as well as Federal, Provincial and 
area municipalities and agencies. 


7 To establish and maintain a productive liaison with 
staff, the public and other governmental bodies and 
their agencies. 

8 To provide efficient management and supervision of 
the Properties Section. 


9 To maintaina general knowledge of the area happen- 
ings to assist public and staff inquiries. 


Each individual’s goals were complemented with objec- 
tives or action statements and with an identification of 
the measuring device. The process of establishing these 
was finalized throughout the division. Goals and objec- 
tives are, of course, reviewed on a regular basis. 


Some examples of process oriented goals and 
objectives 


Throughout this paper, the importance of the analysis 
and improvement of managerial processes in attaining 
effective and efficient output has been emphasized. By 
setting objectives to improve processes, managers are, 
in effect, providing measures which should help them to 
improve organizational outputs and individual satisfac- 
tion. 


The three preceding examples have included goals and 
objectives set by both line and support departments, but 
those examples do not specifically identify objectives 
which involve the improvement of management proces- 
ses. 


The following, on the other hand, are isolated examples 
of goals and/or objectives developed during the Project 
and designed to improve managerial effectiveness or 

efficiency through process improvements. The meas- 

urement being used is usually inherent in the form of the 
objective. A number of different departments will be 
represented. 


BUSINESS DEVELOPMENT DEPARTMENT 


Goal No. 6 


To undertake the management and administration of 
the Business Development Department in the most re- 
sponsible, efficient and effective manner possible. 


Objectives 


1 To establish and maintain office procedures which 
provide for the most responsible and effective ad- 
ministration of allocated funds and resources. These 
procedures would govern such things as inventories, 
supplies, accounts and payment of accounts, filing 
systems, distribution of literature and information 
both internal and external, and the operation of the 
tourist information booths. Initial assessment to be 
completed by June 30, 1975. 


2 To provide direction and supervision of staff in a 
manner consistent with established personnel 
policies, in order to obtain the maximum man/hour 
efficiency of each staff member. To attempt specifi- 
cally to improve the efficiency of each staff member 
by 10% during the next year in terms of time spent 
processing routine work. 


PLANNING DEPARTMENT 


Goal No. 2 


To strive to develop more efficient operating procedures 
and improved standards and methods consistent with 
good planning and administrative principles, in order to 
implement departmental and City goals in areas of re- 
sponsibility. 


Objectives 


1 By June 1st of each year, study and review the office 
record control, retrieval, and retention system, with 
a view toward reducing the storage space require- 
ments of the department and improving information 
retrieval. 


2 By the end of March, 1977, and in co-operation with 
Supplies and Services, the City Engineer and other 
interested departments, investigate and study the 
ways and means of completing a city-owned land 
file — including property plans, indexing and con- 
tinual file up-date procedures. 


3 By May 31st of each year, review the organization of 
the current planning section so that clearer areas of 
responsibility emerge, by: 


i delegating more responsibility to planners, par- 
ticularly in the area of their providing increased 
direction to their support staff, i.e. technicians 
and draftsmen; and 


ii dividing the technicians’ work areas, and inter- 
changing staff to develop a full working know- 
ledge of the various sections’ responsibilities. 


Goal No. 3 


To establish good working relationships and improved 
communication links with support staff, contributing 
divisions and municipal departments, elected officials, 
government and public service agencies, the land de- 
velopment industry, and the general public at large. 


Objectives 


1 Improve co-operation of lateral divisions and sup- 
port departments and agencies in reporting and 
commenting on current planning proposals; en- 
deavour to have all comments available prior to 
preparing recommendations for the Planning Direc- 
tor, yet at the same time striving to have draft plan 
subdivision reports completed within 60 days of of- 
ficial receipt thereof, and zoning amendment appli- 
cation reports within 14 days of receipt. 


2 Ona continuing basis, and specifically by December 
31st ofeach year, review the success of the goals and 
objectives of the previous year and in co-operation 
with staff members develop a new program for the 
ensuing year. 


CLERK’S DEPARTMENT — ADMINISTRATIVE DIVISION 


Goal and Associated Objectives 


January 1st, 1977 to March 1st, 1977 

To co-ordinate and to standardize procedures in the 
preparation of agendas and minutes for meetings of 
staff, executive, general and council in order to facilitate 
various objectives relating to: 


a training of committee-secretary (intensive training to 
be completed by June 1st, 1977); 


b continuance of training of clerk-secretaries in pres- 
ent functions and in any new duties resulting from 
re-organization of department (December 1977); 


c streamlining of indexing (April, 1978); 


d development of procedural manual for section (De- 
cember, 1977); and 


e develop communications with various departments 
respecting their needs vis-a-vis the Clerk’s 
Department’s needs (ongoing). 
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CLERK’S DEPARTMENT-ASSISTANT CLERK, 
ADMINISTRATIVE DIVISION 


Goal No. 1 

To maintain an optimum level of effectiveness and effi- 

ciency in the processing of all phases of re-zoning, etc., 

and to liaise with governmental agencies, public, other 

departments and staff. 

Objectives 

1 To investigate methods by which procedures can be 
streamlined. (January, 1978). 

2 Review structured programs and work habits at 
dated intervals (6 months) with employees. Regu- 


larly assess procedures and systems to provide for a 
broadening of employee knowledge and efficiency. 


3 Have employees state problems with work in report 
form relative to their area of responsibility, prior to 
review dates. 

4 Report unresolved problems to the Department 

Head on sectional review date for discussion and 

resolution. 

Assess recommended solutions and relay to staff for 


discussion and implementation (4 weeks after receipt 
of complaint). 


Nn 


6 Implement training procedures for backup staff. 
PARKS AND RECREATION DEPARTMENT 


Goal No. 6 


To make the most effective use of financial resources. 

Objectives 

1 To have prepared by June 31, and updated yearly, a 
list of all sources of funds, other than from Munici- 
pal tax levies, available for Parks and Recreation 
purposes. 

2 To establish a system where any new fund sources 
arising between yearly reviews will be made use of, if 
appropriate. 

3 To review rates and fees charged on a yearly basis, 
and to recommend changes where appropriate. 
(During the month of October.) 


4 To review the use of all facilities where additional 
rental revenue could be realized by the active promo- 


tion of such facilities to encourage maximum use. 
(By November, 1976.) 


5 To obtain from the Finance Department the neces- 
sary information, statements, or print-outs, in a 
reasonable period of time, which will allow this De- 
partment to meet its commitments such as budget 
submission deadlines, and also to take any action 
throughout the year which may be indicated as 
necessary or desirable from the content of this in- 
formation. 


Performance measurement in the municipalities in- 
volved in the project 

The following contains a brief description of LGMP 
experiments and progress with measurement in the four 
Project Municipalities. 
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THE REGIONAL MUNICIPALITY OF NIAGARA 


The Department Head, and the division heads of the 
Public Works Department, clarified the functions of the 
Department and re-organized by grouping those func- 
tions into logical categories. These functional groupings 
provided guidelines for structure and for the allocation 
of personnel. 


By clarifying the roles of the new divisions it became 
possible to set meaningful goals and objectives at the 
departmental, divisional and, eventually, lower mana- 
gerial levels. The division heads worked with the De- 
partment Head asa senior staff team and brought feed- 
back on the effectiveness of mutual processes and joint 
accomplishments to the forefront. Clear measureable 
objectives were established at each management level 
but the main accomplishment was the establishment of 
processes for mutual problem identification, reviews of 
progress, and the improvement of support services. 


The Homes for the Aged Department neededa medium 

to help in the establishment of clear targets, to outline 
specific programs, and clarify responsibilities for the 

various categories of staff. The goal and objective pro- 
cess, combined with team problem identification and 
inter-group feedback and role clarification workshops 
helped to accomplish these aims. Clear objectives were 
established for each Home and each new program had 
definite review dates and criteria for success. 


Measures generally took the form of broad criteria for 
program success and mutual feedback reviews. As the 
programs developed, client feedback measures were 
being established but these had not reached a state of 
sophistication by the end of the formal Project. 


The process of goal and objective setting proved most 
useful as a tool for clarifying purpose and responsibility 
for departments such as Planning, Finance, and Social 
Services. The Planning Department defined a greatly 
expanded role for itself and then needed to establish a 
structure which would enable the managers to fulfill 
that role. Criteria were established to indicate whether 
or not the role was being fulfilled. This initiative by the 
Planning Department plus a physical planning initiative 
by the Public Works Department, resulted in some in- 
terdepartmental conflict but the resolution of that con- 
flict proved to be healthy since it brought many prob- 
lems to the forefront and a process of problem resolu- 
tion was established. 


The conflict resolution process, plus the perceived need 
to improve certain support services, presented some 

challenges to the Committee of Department Heads and 
helped to open communication at the top administra- 
tive levels. While the Committee of Department Heads 
did not set objectives as a unit, the requirements of 

individual departments to interact with other depart- 


ments acted as a force to improve co-ordination and 
communication. 


As a result, processes of management were improved 
and departments outlined specific targets. Measures 
largely took the form of indicators of objective accomp- 
lishment and were largely concerned with getting the 
job done economically with, unfortunately, little em- 
phasis upon client feedback. 


One major department identified severe internal con- 
flicts, a lack of trust, and an evident confusion regarding 
its role. It would have been inappropriate to superim- 
pose an output measurement system upon this depart- 
ment. Output measurement and associated control pro- 
cesses had been attempted in the past but were regarded 
with suspicion and consequently abused. Individuals 

tended to manipulate the performance measurement 

data for their own internal political reasons, as they 

frequently will under an imposed measurement system. 
Thus processes of conflict resolution were emphasized 
and the desirability of more open communication stres- 


sed. 


OTTAWA 


In Ottawa, the principal beneficiaries of the goal and 
objective system were the Physical Environment and 
Finance Departments. With strong internal leadership 
the Physical Environment Department managers were 
able to set meaningful goals and objectives throughout 
the entire department. Having established goals and 
objectives at all levels, the measurement aspect involved 
team reviews at each management level to keep the 
objectives up to date. Monthly meetings were scheduled 
for management teams?® at each level to discuss mutual 
problems and to modify objectives and behaviour 
where necessary. 


The goal and objective setting process and monthly 
meetings did much to clarify responsibility and to pro- 
mote communication and co-ordination throughout 
the department. The result was a departmental close- 
ness and cohesiveness that had not previously existed. 
Many of the department objectives involved an em- 
phasis upon service while others emphasized process 
improvement. Measurement was largely concerned 
with determining the degree to which objectives had 
been accomplished and it was thus a part of the total 
management process. 


With little Lgmp help, the Finance Department went 
ahead to set objectives for internal programs. Since 
Finance was primarily responsible for the establishment 
of the budget process, the financial information system 
and central purchasing, the department was very in- 
terested in developing effective processes for manage- 
ment in those areas. Ottawa lacked the necessary degree 
of co-ordination between departments to establish joint 
objectives in support service areas. Without that co- 
ordination, the Finance Department was virtually help- 
less to proceed with management improvement in fi- 
nancial areas which affected all departments. In fact, 
Finance initiatives were looked upon with suspicion by 
other departments and thus Finance was limited in the 
degree to which the Department could introduce sys- 
tematic approaches to management. 


ST. CATHARINES 


The emphasis in St. Catharines was upon the develop- 
ment of effective teamwork at the top administrative 
level. The senior management team was a forum where 
issues involving several departments could be discussed 
and from which a corporate advisory to Council could 
eminate. There were two ways in which the effective- 
ness of the senior management team was measured. 


1 The members of the team were asked at intervals, to 
indicate how effectively they thought the team was 
performing its function. In this way, subjective 
evaluations were obtained, although at first mana- 
gers found it difficult to evaluate the team because its 
role had not been clarified. 


2 Goals and objectives were established for the team in 
areas where it seemed to be carrying out an on-going 
management process. The objectives specified par- 
ticular targets which seemed to have consensual im- 
portance. 


In most departments,measurement took the form of 
indicators of objective accomplishments similar to 
those described earlier for the region of Niagara. As 
departmental goals and objectives became firm, de- 
partment heads recognized a number of areas where 
firm council policy was required. The senior manage- 
ment team consolidated these ‘issue’ areas and met with 
Council to discuss them. After the first very successful 
council — administrative problem-solving workshop, 
such workshops were adopted on a routine basis. Each 
workshop was evaluated by subjective participant input 
to a questionnaire. 


LONDON 


In London, the definition of responsibilities, the iden- 
tification of work overlaps and the improvement of 
co-ordination and co-operation were emphasized, be- 
cause these were clearly identifiable weaknesses at the 
outset. It would have been almost impossible for sup- 
port departments and divisions, in particular, to set 
meaningful goals and objectives without clarification in 
these areas. In some cases, it was necessary to establish 
communication channels, e.g. management team meet- 
ings, and to ensure that these channels were operating 
freely, before meaningful, management related goals 
and objectives could be set. 


Two departments in London, Police and Finance, were 
very much influenced by the goal and objective concepts 
but chose not to become involved in an integrated sys- 
tem with other departments. Instead, they established 
goal and objective systems geared directly to their own 
needs. Each of the two largest departments, Commun- 
ity Services (Planning Division particularly) and En- 
gineering, spent considerable time writing, critiquing 
and co-ordinating goals and objectives. 


In all four of these municipalities the LGMP was particu- 
larly involved with process oriented and fiscal meas- 
ures, far more so than with output or program meas- 
ures. This involvement emerged because the philosophy 
of the LGMP embodied the development of systems 
whereby managers could develop their own measure- 
ment activity according to their own criteria and needs. 
The LGMP was not a vehicle to provide managers with 
measures, rather they were encouraged to develop 
measures, through the initial establishment of goals and 
objectives. 


30 A management team includes each manager plus his immediate 
subordinates. 
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In all, approximately two-thirds of the managers in the to be support service managers, e.g. legal departments, 


four municipalities, who came into contact with the which either did not see the need to be involved in an 
LGMP, adopted a goal and objectives system of man- integrated system or had difficulty setting objectives 

agement, and the measurement systems were largely without prior involvement in the process by all other 
tied to the accomplishment of objectives. Those who departments. 


did not develop systematic goals and objectives tended 


Appendix Il 


Performance Measurement: 


A Selected Annotated Bibliography 


The bibliography is divided into two sections. The first 
lists papers, documents and articles, which relate 
directly to performance measurement programs that 
are being carried out in municipalities. These are ar- 
ranged in alphabetical order. Most of the items in this 
section have been received in correspondence with the 
municipalities and are not generally available. The sec- 
ond section contains more general articles and papers 
about performance measurement in municipalities. 
These are more readily available from publishers. This 
section is not intended to represent an exhaustive survey 
of the literature on productivity measurement. It rep- 
resents those publications that the Lgmp Team found to 
be most useful in a study of this area. The emphasis is on 
the practical side with most of the more theoretical 
publications and documents having been omitted. 


Any questions about how to obtain any of the docu- 
ments listed may be addressed to the authors at the 
School of Business, Queen’s University. 


PERFORMANCE MEASUREMENT PROGRAMS 


BURNABY, BRITISH COLUMBIA 


Hay Associates, Accountability Management, Prepared 
for the Municipality of Burnaby, by Hay Associates 
Canada Ltd., Vancouver, Canada, March, 1974. 


Manual prepared to guide the municipality in introduc- 
ing a performance appraisal program. The program ts 
based on setting personal goals, identifying accounta- 
bility spheres and measuring performance against ac- 
countabilities. 


CHARLOTTE, NORTH CAROLINA 


Malizia, Emil E., and Melvin, Robert L., Working 
Paper #3, Charlotte rmis Project, Charlotte, 1971. 


A paper outlining the efforts in constructing perfor- 
mance indicators as part of the attempt to construct an 
information system for the city. These are essentially 
effectiveness and efficiency indicators or potential de- 
mand indicators useful for management planning. 


Objectives: Fiscal Year 1974 Program Budget, Char- 
lotte, 1973. 


Productivity measures are used in many areas. These are 
primarily input/output measures. For each division ofa 
major program, goals are defined, objectives and re- 

sources required to meet objectives are then outlined. 


CINCINNATI, OHIO 


Koch, Vernon E., ‘Cincinnati’s Budget Developments’, 
Public Administration Review, Spring, 1960, pp. 
74-85. 


Report describes the experiences of the municipality 
with performance budgeting. The author provides a 
good critique of the problems in using performance 
budgeting. 


DISTRICT OF COLUMBIA 


Improving Program Performance, (A report on the de- 
velopment of a performance monitoring system for the 
District of Columbia Government), March, 1975. 


This publication describes work that has already been 
done and future actions that are planned for the District 
of Columbia’s Performance Monitoring System (PMs). 
Elements of pMs are described and examples are given 
of how the District improved service performance. 


Guidelines for Developing a Performance Monitoring 
System in the District of Columbia Government, Office 
of Budget and Financial Management, Washington, 
DEGeeApii Layo. 


A description of a performance monitoring system im- 
plemented in D.c., as a basic resource management 
concept, providing an information base for decision- 
making to improve the delivery of services. Strongly 
connected with accounting (as management control). 
‘Similar methods for similar purposes’ complete the 
resource management cycle. This paper discusses three 
key elements; performance criteria, planned perfor- 
mance targets and performance reports. It outlines the 
scope and content of the program. Various measures 
are classified and development strategies and schedules 
are summarized. 


Managing Urban Resources, A Report on the Mayor’s 
Executive Seminar on Policy Formulation and Re- 
source Management, Government of the District of 
Columbia, November, 1972. 


A collection of addresses and discussion of a seminar 
held in Washington on productivity. Hayes and Hamil- 
ton from New York spoke on ‘The Process of Policy 
Formulation and Resource Management’ and ‘Produc- 
tivity in the Public Sector’ respectively. Graeme Taylor 
also spoke on ‘Analysis and Evaluationin Management 
Decisions’. 


FAIRFAX COUNTY, VIRGINIA 


Office of Research and Statistics, Monthly Report to the 
County Executive: Measuring the Effectiveness of the 
Fairfax County Government, Fairfax County, Sep- 
tember, 1973. 


Includes management indicators for each department, 
and compares them to preceding months and years. 
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Also shows measures of effectiveness in graph form, 
and measures of effectiveness for some programs. 


Finz, $.A., ‘Productivity Analysis: Its Use in a Local 
Government’, Government Finance, November, 
1973, pp. 29-33. 


By the Director of the Office of Research and Statistics 
of Fairfax County, Virginia. He speaks generally of the 
use of productivity measurement for local government, 
referring to the Fairfax experience for examples. He 
highlights the need for a system of measures of effec- 
tiveness which in turn requires a set of goals and objec- 
tives for each agency. Discusses the kinds of objectives 
for each agency and the kinds of objectives for different 
departments. Relates goals, objectives and indicators to 
PPB. 


FORT WORTH, TEXAS 


Fort Worth Annual Budget and Program Objectives, 
1974-75 Fiscal Year, Fort Worth, 1974. 

A budget which attempts to set goals and measure the 
effectiveness of programs. An attempt at trying to quan- 
tify effectiveness where possible. 


Fort Worth Public Works Productivity Improvement 
Projects, December, 1969. 


Letter and report describing the activities undertaken in 
the city’s program management program. A brief out- 
line is given of four productivity improvement projects. 
These projects, in the Public Works Department, in- 
clude; four day task incentive work week, one way 
disposable containers, utilization of larger collection 
vehicles and a street cleanliness rating system. 


STATE OF GEORGIA 


State of Georgia Office of Planning and Budget: General 
Budget Preparation Procedures, 1978 Fiscal Year, State 
of Georgia, June, 1976. 


Publication instructs staff of the Office of Planning and 
Budget how to prepare their budgets. Illustrates the 
extent to which zero based budgeting is being used in 
the State of Georgia. 


Minmier, George S., and Hermanson, Robert H., ‘A 
Look at Zero-Base Budgeting — The Georgia Experi- 
ence’. Atlanta Economic Review, July/August, 1976, 
pp. 5-12. 

Article analyzes the experiences of The State of Georgia 
with zero based budgeting. Author uses questionnaire 
to determine if the concept had any positive or negative 
aftect. 

GREENWICH, LONDON, ENGLAND 


Community Plan and Program Budget, 1973-1974 

to 1976-1977, Greenwich, 1973. 

Indicates activities in each of seven program areas, for 
the four years 1973-1977. Input is shown in terms of 
financial resources, output in terms of results which 
show the effectiveness of each program. Gives examples 
of output measurement and quantified objectives. 


KANSAS CITY, MISSOURI 


Industrial Engineering Program: Administrative Regu- 
lation 1-11, Kansas City, August, 1973. 
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Anadministrative regulation describing a new program 
designed to measure and improve the productivity of 
selected programs and departments of the city. Includes 
documentation of a pilot project done with Streets 
Maintenance. 


Urie, J.M., ‘Increasing Productivity: A Goal of Kansas 
City,’ Government Finance, November, 1973. 


This article focuses on Kansas City’s use of industrial 
engineering techniques to establish work standards in 
an attempt to improve overall performance in the deliv- 
ery of service. An example of the program’s use in the 
Finance Department is provided. 


CITY OF LAKEWOOD, COLORADO 


Program Performance Budget 1977, Proposed, Office 
of Budget and Research, Lakewood, Colorado. 


Comprehensive, detailed budget based on programs. 
For each program, objectives are set and measurement 
criteria identified. 


Henderson, Bill and Young, Randy, Program Perfor- 
mance Budgeting: An Effective Public Management 
System for Evaluating Municipal Services, Special Bul- 
letin, Municipal Finance Officers Association, February 
25, 1976. 


The authors contend that the management system de- 
veloped by Lakewood, Colorado, meets the public de- 
mand for more effective planning and evaluation of 
programs. Aspects of this system are as follows, prog- 
ram planning and evaluation, performance accounta- 
bility, total resource allocation and financial manage- 
ment reporting and control. A description of the de- 
velopment of this management system is provided. 


LITTLE ROCK, ARKANSAS 


Buntin, D.P., Standard Workday Study for Residential 
Refuse Collection. 


Utilizing the concepts of route completion incentives, 
route balancing, route optimizing, and standard work- 
day routines, the City of Little Rock was able to affect a 
21% increase in the productivity of its refuse collection 
system. This publication describes in detail the experi- 
mental design, data collection, data analysis, implemen- 
tation and follow-up components of the study. 


Lubin, R., The Little Rock Custodial Make-Buy Study: 
A Transferable Technology. 


This paper deals with the development of a study to 
determine whether Little Rock should continue to pro- 
vide custodial services with its own staff, or whether it 
should contract these services. A clear description of the 
study methodology is presented and suggestions are 
made as to the general applicability of this methodology 
to other cities concerned about their custodial services. 


LONDON, ONTARIO 


Administration of Engineering Work and Construction 
Projects, London, 1973. 


A summary of results of collaboration with consultants 
to improve the effectiveness of engineering and con- 
struction administration. Schedules, activity reporting, 
standard cost and performance evaluation are discussed 


with recommendations. Sample forms, tables and 
charts are included. 


LOS ANGELES, CALIFORNIA 


Eghetedari, Ali and Sherwood, Frank, ‘Performance 
Budgeting, Has the Theory Worked? Performance 
Budgeting in Los Angeles’, Public Administration Re- 
view, Spring, 1960, pp. 63-69. 


Article describes the advantages and disadvantages of 
performance budgeting as a means of converting the 
line budget in the municipality of Los Angeles. 


Hirsch, Werner A., Sonenblum, Sidney and Teeples, 
Ronald K., Local Government Program Budgeting: 
Theory and Practice, With Special Reference to Los 
Angeles. Praeger Publishers, New York, 1974. 


This concise book examines, reviews, and summarizes 
the most significant conceptual and applied issues of 
local government program budgeting. The authors dis- 
cuss the experiences of large and small local govern- 
ments in organizing the program budgeting effort, de- 
signing program budget structures and conducting 
program analysis. Criteria for trade-off analyses, the 
interpretation and measurement of costs and benefits, 
and budget structures, are evaluated. Specific program 
analyses, including benefit-cost, cost-effectiveness, 
production function, inter-governmental and multi- 
year analyses, and program structures for police, educa- 
tion, recreation, health and welfare services are de- 
scribed and evaluated. 


McMASTER UNIVERSITY, HAMILTON, ONTARIO 


Letters, memo and procedure manual on McMaster 
University’s experiences with zero base budgeting to 
June; 1977. 


MacFarlane, John A., ‘Zero Based Budgeting in Ac- 
tion’, CA Magazine, December, 1976, pp. 27-31. 


The author presents the successful experiences of 
McMaster University with the concepts of zero based 
budgeting. 


NASHVILLE, TENNESSEE 


Programs for the 70’s: Proposed Operating Budget 
1973-1974, Nashville, 1973. 


A program budget which states general goals and more 
specific program objectives. Where possible, 
performance/productivity measures have been in- 
cluded. In some areas the output measures give a good 
indication of efficiency. 


Burt, MarvinR. and Blar, Louis H., Options for Impro- 
ving the Care of Neglected and Despondent Children, 
The Urban Institute, Washington, D.c., March, 1971. 


A study aimed at developing and demonstrating im- 
proved methods by which local governments can 
analyze their programs and policies. An analysis of the 
child care system of Nashville is undertaken. This is 
directed at the overall system, identifying public objec- 
tives for the system and selecting specific evaluation 
criteria by which the objectives might be measured. 
Alternative programs are identified and examined in 
terms of costs and effectiveness. 


NASSAU COUNTY 


An Approach to Productivity Improvement in the Pub- 
lic Sector: A Procedural Manual, Multi-Municipal Pro- 
ductivity Project of Nassau County, Town of Hemp- 


stead, Town of North Hempstead, Town of Oyster Bay, 
The Civil Service Employees Association, July, 1975. 


This manual reports on a project which was funded by 
the u.s. Department of Labour and the National Com- 
mission on Productivity and Work Quality. The ap- 
proach taken is through systems analysis rather than by 
evaluation of individual performance. A step-by-step 
procedure for conducting a productivity improvement 
effort is presented. This procedure concentrates on the 
aspect of organizational change. 


NEW YORK, NEW YORK 


Hamilton, Edward K., ‘Productivity: The New York 
City Approach’, Public Administration Review, 
November-December, 1972. 


A description of the Nyc Productivity Program includ- 
ing a discussion of the problems of increasing local 
government productivity. It examines why the program 
was started and where it was at the time of writing. Also 
includes examples of how the program has decreased 
unit costs and improved the use of resources in a 
number of areas. 


Hayes, Frederick O.R., Creative Budgeting in New 
York City, An Interview with former Budget Director 
Hayes, Urban Institute, June, 1971. 


An interview in question/answer format which covers 
the New York experience with implementing PPB. Out- 
lines approach taken, and describes project monitoring 
and information systems. 


Productivity Program, August 7, 1972, New York, 
1972. 


A report for each city department outlining accomp- 
lishments for fiscal year 1971-1972, giving a summary 
in measureable terms of objectives for Fy 1972-1973, 
followed by actual objectives. Also provides informa- 
tion on programs, units of measure, current and prop- 
osed levels of productivity. 


Productivity Program, Annual Summary, Fiscal Year 
1972-1973, New York el 973; 


A summary of year one of the project with historical 
data for comparison where possible and appropriate. 
Also provides a summary of the productivity of each 
department. 


Productivity Program, Fiscal Year, 1973-74, New 
Yorke 1973. 


A report of the second year of operation in the produc- 
tivity program. Introduction discusses problems of con- 
tinuity. Again, summaries of productivity of each de- 
partment are provided. 


Productivity Program, Fourth Quarter Progress Re- 
ports, New York, July, 1973. 


Last of the quarterly reports tabulating month by 
month results for each performance target. These re- 
ports are the basis of the annual reports. Outlines 
noteworthy achievements, problem areas and depart- 
mental details. 


ORANGE, CALIFORNIA 
Productivity Standards Development, February 24, 
19 


1975, to June 1, 1976, California I.P.A. Project, 74-40. 


Report outlines the municipality’s attempt at reducing 
the cost pressures facing them, by improving productiv- 
ity. Aspects of the program included the development of 
productivity measurement standards for all city func- 
tions. 


Objectives and Effectiveness Factors for Budget Struc- 
tures, County Administrative Office, Orange County, 
California, June 30, 1972. 


A book which presents both the philosophy and 
methodology of setting goals and objectives within a 
budgeting framework, as well as developing effective- 
ness measures. Examples are drawn from the program 
of Orange County, and recommendations are offered. 
Five appendices include a glossary of 22 terms, types of 
measures and means of evaluating them, potential out- 
put and effectiveness measures, an examination of de- 
partment interfaces and a very brief bibliography. 


PALO ALTO, CALIFORNIA 


Barbour, George, Plan for the Development of a Service 
Management System for the City of Palo Alto, Califor- 
nia, Palo Alto, 1973. 


An outline of the steps required to implement an 1m- 
proved service management system. A large part of this 
process consists of the development and implementa- 
tion of measures of performance. Efficiency and effec- 
tiveness measures are emphasised. 


Barbour, George, Development of Performance Meas- 
ures, Palo Alto, October, 1973. 


Instructions for the development of departmental 
measures of performance. The three main types of 
measures covered and explained are workload meas- 
ures, efficiency measures, and effectiveness measures. 


Barbour, George, Revision of Program Statements: 
Why? How?, Palo Alto, October, 1973. 


Instructions to practitioners on revising program 
statements. with particular emphasis on expressing the 
statements in terms of objectives with specific meas- 
urement criteria identified for each. 


PHOENIX, ARIZONA 


Proposed 1976-1977 Annual Budget, City of Phoenix, 
Arizona, submitted by the City Manager, May 14, 
1976. 


Planning-Programming-Budgeting-System: An Evalu- 
ation for the City of Phoenix. An internal report from 
Phoenix Budget and Research Director C. Hill to City 
Manager John Wentz, June 30, 1971. 


SAN DIEGO, CALIFORNIA 


Final Report, PPBS - HUD Project, Department of the 
Budget, San Diego, July, 1971. 


A brief summary of the major findings from pps efforts 
in San Diego to July, 1971. Analyzes how pps must fit in 
with municipal government, and outlines the need for 
goals and objectives, measures of effectiveness and in- 
formation systems. 


City of San Diego Program Budgeting - The PPBS Task 
Force, Comprehensive Management Planning Prog- 
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ram, Financial Management Department, San Diego, 
California, December, 1976. 


The attempt of a special pps task force to assist in the 
development and refinement of the city’s program 
budget is covered in this report. The report elaborates 
on task force efforts to: improve the delineation and 
structure of programs contributing to departmental ob- 
jectives; develop specific and quantifiable statements of 
intended results of programs; develop more meaningful 
measurements of program products or results. 


ST. PETERSBURG, FLORIDA 


Anderson, B., ‘A Ninety Degree Turn’, Government 
Finance, November, 1973. 


An essay stressing the need for an effective com- 
puterized financial information system for local gov- 
ernment. Describes the new system in St. Petersburg 
which has the characteristics of a successful informa- 
tion system. 


Jreisat, Jamil, Measuring Output of Urban Programs 
and the Effects of Measurement on Administrative 
Change: The Case of St. Petersburg. (Prepared for de- 
livery at the Annual Meeting of the American Society 
for Public Administration, Chicago, April 2, 1975.) 
University of South Florida, Tampa, Florida, 1975. 


Examines from an outsider’s viewpoint the new system 
of productivity measurement implemented in the city 
government of St. Petersburg, and describes some of its 
major characteristics. The author’s study assessed ad- 
ministrative adaptability and change instigated or af- 
fected by information derived through measurement of 
output. It also determines the quality of output pro- 
duced by various programs subjected to measurement, 
particularly a) the degree of satisfaction of the clientele 
receiving the output, and b) the degree of satisfaction of 
staff in the various operations of the city. Some useful 
observations are made in the final section concerning 
difficulties with measures, their use, and the system in 
general. 


City-wide Effectiveness/Productivity Measurement 
System Project for St. Petersburg, The Urban Institute, 
Washington, D.c., 1974. 


Describes a joint project being carried out in St. Peters- 
burg and Nashville, giving the background of the Pro- 
ject and the major characteristics of the effort to de- 

velop ‘citizen impact’ measures of effectiveness and effi- 
ciency of local government services. 


Barbour, George P., ‘Productivity Measurement: The 


ICMA Viewpoint,’ Government Finance, November, 
| Be Fo 


A brief history of the 1cMa’s involvement with produc- 
tivity and an outline of the St. Petersburg-Nashville 
Davidson productivity measurement project. 


SUNNYVALE, CALIFORNIA 
Joint Financial Management Improvement Program: 


Annual Report to the President and Congress. Produc- 


tivity Programs in the Federal Government FY 1974. 
Volume Two: Case Studies. 


Describes the evolution of a management information 


system for Sunnyvale, California. The link between the 
MIS and program budgeting is illustrated. The report 
discusses the techniques identified by Sunnyvale as 
being primarily responsible for the successful im- 
plementation of the program. 


WESTINGHOUSE, CANADA LTD. 


Manual and report on the introduction of zero based 
budgeting in Westinghouse Canada Limited. Report 
describes the experiences learned, and the process 
utilized. Relevant examples of zero based budgets are 
included. 


WILMINGTON, DELAWARE 


Smith, Bruce A., and Goldlust, Perry F., Wilmington 
Productivity Management Program - A Study of Solid 
Waste Collection Practices, Wilmington, Delaware, 
November, 1975. 


Report outlines how the municipality was able to make 
significant cost savings in its solid waste collection op- 
eration. The method used to achieve cost reduction/ 
productivity improvement was the reduction of crew 
sizes from five to three. 


WISCONSIN 


Lucey, Patrick J., “Wisconsin’s Productivity Program’, 
Public Administration Review, November-December, 
1972. 


An account of a program instituted in 1972, with the 
goal of increasing productivity. The program was im- 
plemented from the top down. This article describes the 
difficulties of implementation and operation, and of 
communicating the basic elements of a productivity 
program. 


Productivity in Brief, Wisconsin Department of Ad- 
ministration, September, 1973. 


A description of the background, development and re- 
sults of the Productivity Improvement Plan. Appendices 
show productivity charts of certain agencies and answer 
questions on productivity in general. 


1973-1975 State Budget Tax Relief and Policy Reform, 
State of Wisconsin, August, 1973. 


An innovative budget to be used as the major policy 
instrument for Wisconsin, incorporating the 
Governor’s Productivity Program. 


PERFORMANCE MEASUREMENT IN GOVERN- 
MENT 


General publications 


1 Anthony, R., ‘Closing the Loop Between Planning 
and Performance,’ Public Administration Review, 
Vol. 14, May, 1971, pp. 388-398. 


Highlights the importance of the accounting func- 
tion and estimates of operating costs. Succinctly 
covered are such areas as investment costs versus 
operating costs, measuring expenses, variable and 
non-variable costs, program elements and respon- 
sibility centres. 


2 Bauer, Raymond A. (ed.), Social Indicators, The 
MIT Press, Cambridge, 1966. 


This book focuses on social indicators used in 

American society. Social indicators are defined as 
measures that enable us to assess where we stand 
and are going with respect to our values and goals, 
and to evaluate specific programs and determine 
their impact. A useful introduction to the subject. 


Beatty, Donald W. (ed.), ‘Measuring Government 
Effectiveness’, Government Finance, November, 
1973, (entire issue devoted to this topic). 


a ‘Increasing Productivity: A Goal of Kansas 
City’, by John Urie; 

b ‘Applications of Productivity Measurement in 
Local Government’, by Harry P. Hatry; 

c ‘Productivity Measurement: the ICMA View- 
point’, by George P. Barbour Jr.; 

d ‘A Ninety Degree Turn’, by Bond Anderson 111; 

e ‘Efficiency and Effectiveness in State and Local 
Government’, by Kenneth S. Calwell; 

f ‘Productivity Analysis: Its Use in Local Govern- 
ment’, by Samuel A. Finz; 

g ‘Commentary’, by John V. Lindsay and Gov. 
Patrick J. Lucey. 


Berkshire, Tom, ‘Developing a System of Meas- 

urement in a Metropolitan Authority — Early Ex- 
periences of the Greater London Council’, Local 
Government Studies, February, 1974, pp. 39-52. 


As part of its plan to employ a corporate manage- 
ment system, the GLC has been developing a system 
which measures the activities of the Council, in 
order that decision-making can be improved 
through the systematic use of the quantitative in- 
formation generated. This article discusses the 
evolution, examples of measures used, and some of 
the problems yet to be overcome. 


Boots, A., Dawson, G., Silverman, W., Hatry, H.P., 
Inequality in Local Government Services: A Case 
Study of Neighbourhood Roads, The Urban Inst- 
tute, Washington, D.c., 1972. 


A method for obtaining data on the provision of 
local government services, applied in case study of 
roads in Fairfax County, Va. Discusses services 
measurement, data analysis and variables, etc. Pro- 
vides tables. 


Brummett, Lee, “Total Performance Measurement’, 
Management Accounting, November, 1973, pp. 
11-15; 


An article calling for a conceptual broadening of 
the role of accounting into performance measure- 
ment in the public sector. “Total performance’ as- 
sessment is defined as a function of net income, 
human resource contribution, product or service 
contribution, and environmental contribution. De- 
tails for each category are suggested and forms of 
reckoning outlined. Performance is then related to 
quality of life and a potential role for accountants 
suggested. 


Budmen, Bernard, ‘New Approaches to Govern- 
mental Delivery Services; in Budmen, Bernard and 
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Adams, Harold, Organization Development: Im- 
proving Government's Delivery Systems, 8th Con- 
ference, University of Connecticut, Albany, N.Y., 
November, 1971. 


Discusses the problems of performance measure- 
ment in local government, and offers solutions in 
the form of advice on how to go about the process. 
Three catch-phrases summarize the advice: think 
small, think early and find out what other people 
are doing. 


Butt, R.B., ‘A Feasibility Study of ppBs in Glouces- 
tershire’, Local Government Studies, April, 1972, 
pp. 37-52. 


This is an account of a feasibility study of PPB, its 
organization, sequence of steps and results. De- 
scribes the organization and management system of 
the County Council before implementation and con- 
cludes with a description of anticipated changes as 
a result of the decision to adopt PPB. 


Byron, R.J., ‘Reviewing a Program Budgeting Sys- 
tem in a Municipality’, Journal of Systems Man- 
agement, Vol. 22, April, 1971, pp. 33-39. 


This article details the efforts of Anaheim, Califor- 
nia, in introducing program budgeting. Emphasis is 
placed on reviewing the program budget in terms of 
costs and effectiveness. 


Caldwell, K.S., ‘Efficiency and Effectiveness Meas- 
urement in State and Local Government’, Govern- 
ment Finance, November, 1973. 


A clearly presented case for measures of efficiency 
and effectiveness in government, stressing the most 
important “do’s and don’ts’, the need for quantifi- 
cation, the role of performance budgeting and need 
for user’s viewpoint. Provides concrete examples of 
program areas, goals, objectives, measures, and 
limitations imposed by local resources. 


Campbell, D.S., ‘Planning, Programming and 
Budgeting in the Ontario Government’, Cost and 
Management, July-August, 1975, pp. 6-12. 


A primer on pps and the extent of its operation in 
the Ontario Government. Describes the Ontario 
experience in terms of six key elements in the ppB 
process. These elements include: 
a analyzing tomorrow’s environment; 
setting specific statements of desired future re- 
sults; 
c determining the best strategy for meeting objec- 
tives; 
d defining financial and personnel resources to 
implement the strategy; 
e determining if objectives have been met; and 
f linking all elements in a comprehensive consis- 
tent system. 
Finally, the author makes some brief recommenda- 
tions as to how Ontario’s pps system could be 
improved. 
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Carter, Novia and Wharf, Brian, Evaluating Social 
Development Programs, Canadian Council on So- 
cial Development, Ottawa, Ontario, 1973. 


This publication addresses itself to the need for 
evaluation research on social programs as a means 
for helping decision-makers to design better prog- 
ramming in the future. The authors review the lit- 
erature on evaluation, pointing out problem areas. 
They develop a ‘framework for practice’, which is 
designed to be used as an evaluation plan. 


Committee on Government Productivity, Commit- 
tee on Government Productivity Report #10, On- 
taro. 


A report of the committee on government produc- 
tivity appointed to recommend ways of improving 
efficiency. Summarizes both the recommendations 
presented in earlier reports, and the methods and 
results of the inquiry. Also discusses possible valu- 
able areas for study in the future, and a program to 
monitor and evaluate the benefits resulting from 
implementation of committee suggestions. 


Council on Municipal Performance, “Coterminal- 
ity’, COMP News, November 29, 1976. 


This issue is devoted to ‘coterminality’ — a remedy 
that ensures that city agencies’ service areas coin- 
cide. The problems with making municipal gov- 

ernments more responsive to citizen complaints are 
discussed. Twelve issues of COMP News are pub- 
lished annually. These issues provide objective in- 
formation regarding municipal performance and 

present new developments in municipal evaluation. 


Council on Municipal Performance, Municipal 
Performance Report, published bi-monthly. 


This is one of the vehicles of CoM? in its efforts to 
‘disseminate unbiased and detailed information on 
the comparative performance of United States cities 
in areas such as criminal justice, economic policies, 
environmental protection, financial management, 
health, housing, taxation and transportation.’ 


Cutt, James, ‘Efficiency and Effectiveness in Public 
Sector Spending: The Program Budgeting Ap- 


proach’, Public Administration Review, Vol. 13, 
1970. 


A theoretical article which exposes some difficul- 
ties in using PPB for evaluation in local government. 
The basic contention is that pps, as originally de- 
veloped, is an extremely complex process and is far 
too complex in most cases to be used for meaning- 
ful evaluation or planning in municipalities. 


Dittenho ffer, Mortimer A., ‘Performance Auditing 
Simplified’, Public Administration Review, 
March-April, 1971. 


An introduction to and definition of performance 


auditing, how it relates to financial auditing and its 
future. 
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Eghetedari, Ali and Sherwood, Frank, ‘Perfor- 
mance Budgeting, Has the Theory Worked? Per- 
formance Budgeting in Los Angeles,’ Public Ad- 
ministration Review, Spring, 1960, pp. 73-69. 


Article describes the advantages and disadvantages 
of performance budgeting as a means of converting 
the line budget in the municipality of Los Angeles. 


Fry, Carroll J., “A Practical Approach to 
Performance-Program Budgeting for a Small City: 
MFOA Special Bulletin 1971 G, (based on a paper 
presented at the 65th Annual Conference, June, 
1971) November 1, 1971. 


A brief paper which begins by outlining the func- 
tion of the budget and the steps in the budgetary 
process. Different approaches to budgeting are 
identified. The experiences of Winona (of which 
the author was city manager) with performance 
program budgeting are then described. Important 
considerations are pointed out, and some cautio- 
nary remarks made. 


Ghorpade, J., Framework for the Measurement of 
Programmatic Effectiveness, The Urban Observat- 
ory of San Diego, San Diego, California, April, 

i edle 


Develops a process for analyzing the effectiveness 
of community action projects using the following 
sequence: 


general description of broad goals; 
identification of project beneficiaries; 
selection of effectiveness criteria; 
identification of data needs; 

identification of data sources; 

evaluation or measurement of effectiveness; and 
evaluation of feedback and restructuring. 


Ciop tanita fake) Remy ( 


Sample applications of the conceptual scheme in six 
U.S. municipalities are provided. 


Gottlieb, J., Productivity in Police Work, Draft 
Summary, National Productivity Commission, 
Tune 121975. 


After explaining why current performance indi- 
cators are inadequate, Gottlieb suggests new im- 
proved measures concerning apprehension of of- 
fenders, crime deterence and provision of non- 
crime services. Suggestions are made for improve- 
ment of patrol productivity, human resource pro- 
ductivity and prevention productivity. 


Grant, Mary Margaret (ed.), ‘Local Government 
Productivity’, Public Management, Vol. 56, No. 6, 
June, 1974 (entire issue devoted to this topic). 


a ‘Productivity Improvement: The Route to More 
Effective Public Management’, by George H. 
Kuper; 

b ‘Issues in Local Government Productivity Meas- 
urement’, by Donald M. Fisk; 

¢ ‘Local Productivity Programs: An Overview’, by 
Donald J. Borut and Steve Carter; 

d ‘Implementation of Productivity Analysis in the 
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County’, by Robert W. Wilson and Samuel A. 
Finz; 

e ‘Charlotte-Management by Objectives’, by 
David A. Burkhalter and Jerry B. Coffman; 

f ‘Barrington Measures Productivity’, by Dean H. 
Maiben; 

g ‘Dubuque — Fiscal Information System’, by 
Gilbert D. Chayenelle; 

h ‘St. Petersburg — Productivity Measurement’, 
by Paul V. Yingst and James L. Cavenaugh; 

1 ‘Nashville-Davidson County — Productivity 
Management’, by Thomas W. Finnie and John 
L; Pazou; 

j ‘San Diego County — Productivity and Evalua- 
tion’, by Frank Aleshire. 


Gross, Bertram J., “The New Systems Budgeting’, 
Public Administration Review, March-April, 
1969, pp. 113-137. 


Gross describes and explains the system of plan- 
ning programming budgeting, giving a history of its 
development and discusses the potential for its con- 
tinued use. 


Guthrie, Thomas L., Productivity Management of 
City Parks Maintenance, Study supported finan- 
cially by the Intergovernmental Personnel Act, In- 
diana Statewide Plan, undated. 


Preliminary report on a productivity program at 

the municipal level of parks maintenance. Study 

was limited to determining measurement criteria of 
park maintenance functions which would provide a 
basis for objective evaluation, thereby giving in- 

sight as to how productivity may be improved. 


Hartle, D.C., ‘A Proposed System of Program and 
Policy Evaluation’, Canadian Public Administra- 
tion, Vol. 16, No. 1, 1973, pp. 243-66. 


This article outlines a framework for integrating 
policy and program evaluation, strategic planning 
and priority problem identification. The author 
lists three tasks to perform to accomplish this ob- 
jective: 


a identify goals and goal areas; 

b specify indicators for measuring progress to- 
wards goals; and 

c identify policy instruments which affect progress 
toward goals. 


Hatry, Harry P., ‘Applications of Productivity 
Measurement in Local Government’, Government 
Finance, November, 1973. 


Written by a recognized authority on productivity 
in local government, this article addresses itself to 
the meaning of productivity and discusses four key 
areas of productivity improvement; cost reduction; 
managerial control; program and policy formula- 
tion; and development of employee incentives. 


Hatry, Harry P., ‘Status of pps in Local and State 
Governments in the United States’, Policy Sciences 
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2, American Elsevier Publishing Company Inc., 
Washington, D.c., 1971, pp. 178-189. 


An introduction to and brief history of PPB are 
followed by an outline of the developments in goal 
and objective setting, program budgets, multi-year 
projections, measures of output, program/policy 
analysis, program evaluation and various other as- 
pects of ppB systems. Another section summarizes 
some of the major barriers to the effective use of 
pps by local and state governments. 


Hatry, Harry P., ‘Issues in Productivity Measure- 
ment for Local Government’, Public Administra- 
tion Review, Vol. 32, No. 6, December, 1972, pp. 
776-784. 


Points out the benefits of measuring the productiv- 
ity of local government agencies but also discusses 
some of the problems involved. The author shows 
how seemingly valid measures may actually be mis- 
leading or even meaningless, and provides some 
pointers as to how to avoid these pitfalls. Contains 
examples of effectiveness measures for local gov- 
ernment services. 


Institute of Municipal Treasurers and Accountants, 
Program Budgeting Implementation - Some Practi- 
cal Problems, Papers from 1971 seminar, Institute 
of Municipal Treasurers and Accountants, Lon- 
don, England, June, 1971. 


a ‘The American Experience’, by I.C. Hancock; 
b ‘Creating the Right Environment’, by H.L. 
Oliver; 

‘Objective Setting’, by R.B. Butt; 

‘Forward Planning’, by J.B. Woodham; 
‘Multi-Purpose Budgeting’, by G.D. Nicholson; 
‘The Self-Evaluating Organization, by 

A. Wildavsky; 

g ‘Information Systems’, by J.K. Hender; 

h ‘Output Measurement’, by J.V. Miller; 

1 ‘Viewpoint’, by A. Williams. 
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International Labour Office, Measuring Labour 
Productivity, New Series, No. 75, Geneva 1969. 


Discusses methodology, problems of measurement, 
various measures, principals governing choice of 
measures, international comparison of levels of 
productivity, etc. Appendices include bibliographi- 
cal references. 


Labour-Management Relations Service, Negotiat- 
ing for Productivity in Sanitation, Washington, 
Dee Fall, 1972. 


This short paper examines unionization in munici- 
pal sanitation operations and the effects of unions 
upon productivity. Areas covered are: measure- 
ment of basic productivity data; conditions favour- 
able for productivity improvement; and manage- 
ment right to sub-contract. The study concludes 
with a number of recommendations for municipal 
sanitation departments. 


Lee, R.D. Jr., and Johnson, Ronald W., Public 


33 


34 


a5 


36 


Budgeting Systems, University Park Press, Balti- 
more, 1973. 


A basic text containing a comprehensive systematic 
presentation of all aspects of budgeting at federal, 
state and local levels. Includes good coverage of 

such topics as PPB, program planning and evalua- 
tion, information systems and intergovernmental 
relations. 


Maanen, John Van, The Process of Program 
Evaluation, National Training and Development 
Service Press, Washington, D.c., 1973. 


Intended as a guide for managers in all types of 
organizations to evaluate programs. The author 
outlines several techniques for conducting a prog- 
ram evaluation which will produce meaningful re- 
sults. 


Management Information Services: Measuring the 
Effectiveness of Municipal Services, CMA, Vol. 2, 
No. LS-8, August, 1970. 


Reports by Management Information Service are 
published monthly by cM. The report quoted 
above is a concise treatment of measures being 
developed to help municipalities determine the 
level of service being provided. In particular, this 
report centers on measures of effectiveness. It de- 
fines the terms, gives relevant examples and out- 
lines the experiences of four municipalities with 
effectiveness measures. 


Manual on Measuring Results: Law Enforcement 
and Criminal Justice Projects and Programs, Pre- 
pared for staff members of the Arkansas Commis- 
sion on Crime and Law Enforcement, Louisiana 

Commission on Law Enforcement and Administra- 
tion of Criminal Justice, New Mexico Governor’s 
Council on Criminal Justice Planning, and Oak- 

lahoma Crime Commission, December 1973. 


Detailed and comprehensive manual discussing all 
aspects of evaluation. Useful guide to those being 
introduced to evaluation of projects, programs. 
Not limited in applicability to law enforcement or 
justice programs. 


Marshall, A.H. Financial Management in Local 


Government, George Allen and Unwin Limited, 
London, England, 1973. 


This book contains a valuable analysis of the role of 
financial management in English local government. 
Written for other managers, as well as finance of- 
ficers, it helps to place the financial function within 
the corporate planning framework. pps and its 
elements are explained, the area of measures re- 
viewed, and the more traditional finance functions 
related to the more recent management ap- 
proaches. The author also explores the relationship 
between elected officials and managers, and the 
roles of the chief financial officer and his depart- 
ment. Throughout, the author maintains a histori- 


cal perspective and discusses possible future de- 
velopments. 
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Milward, Robert E., ‘ppss: Problems of Implemen- 
tation’, Journal of the American Institute of Plan- 
ners, March, 1968, pp. 88-94. 


Written at the height of popularity of the pps sys- 
tem, this article attempts to put a damper on en- 
thusiasm by pointing out some of the system’s in- 
herent conceptual and operational weaknesses and 
by suggesting that pps alone would not solve the 
immense problems faced by public administrators. 


Murray, Thomas J., “The Tough Job of Zero 
Budgeting’, Dun’s Magazine, October 1974, pp. 
70-72 and 128-130. 


A concise article on the introduction experiences 
associated with zero base budgeting. Although the 
author does discuss some of the pitfalls with using 
this technique, he cites numerous examples where 
zero base budgeting has proven successful. 


Mushkin, Selma J., ‘PPB in Cities’, Public Ad- 
ministration Review, Vol. 29, No. 2, March/April, 
1969, pp. 167-178. 


Included in a symposium on ppB, this article de- 

scribes some of the special problems encountered 
by cities which implement the system. The author 
draws on her experience as director of the innova- 

tive ‘5-5-5 Project’, in which PPB was introduced to 
five city, five county, and five state governments in 
the late Sixties. 


Norton, Ronald J., Citizen Survey - The Ombuds- 

man of the Seventies, Prepared for presentation at 
the 1974 National Conference on Public Administ- 

ration. 


An example of a municipality’s attempt to deter- 
mine the services that its citizens want, by the use of 
mail surveys. The aim of this program is an attempt 
to improve the effectiveness and efficiency of the 
municipality’s operation through the improvement 
of several major functions. 


Novick, David (editor), Current Practice in Prog- 
ram Budgeting (PPBS): Analysis and Case Studies 
Covering Government and Business, Crane Rus- 
sak, for the Rand Corporation, New York, 1973. 


This book clearly and thoroughly covers the state 
of practice in PPB up to 1971. The authors provide 
five introductory chapters describing program 
budgeting, giving a brief history and evaluation of 
it. This is followed by a series of case histories on 
PPB in nine national governments (including two 
articles on Canada), two state governments, an 
English local government, New York City, and two 
private organizations. 


Novick, David, “The Origin and History of Prog- 
ram Budgeting’, California Management Review, 
Fall, 1968, Vol.-11, pp. 7-12. 


The history of program budgeting in the federal 
government is traced back to the War Production 
Board in 1942. From here the author describes PPB 
evolution in industry and government. 
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Public Administration Review, ‘Symposium on 
Productivity’, Vol. 32, #6, November-December, 
1972. Centre for Productive Public Management, 
John Jay College, New York, New York. 


A symposium containing essays from thirteen au- 
thorities on productivity and productivity meas- 
urement. Includes accounts of the experience of 
New York, Wisconsin, the Federal Government, 
and productivity in government generally. 


Public Productivity Review, Vol. 1, No. 3, March, 
1976. Centre for Productive Public Management, 
John Jay College, New York, New York. 


Papers and edited commentaries presented at the 
conference on ‘Productivity and Program Evalua- 
tion: Challenge for the Public Service’ held on June 
6, 1975, in Chicago. Authors include Thomas L. 
Guthrie, Harry Hatry, Charles R. Wise, to name a 
few. 


Public Productivity Review, Vol. 1, No. 4., Special 
Issue: Bibliography, 1976. Centre for Productive 
Public Management, John Jay College, New York, 
New York. 


Publication provides a bibliography identifying all 
major works relevant to measuring and improving 
public sector productivity. Each publication is an- 
notated and categorized under useful headings. The 
publication also provides an author index, title 
index, anda list of NCOP current publications. (This 
publication is being updated with 1977 Bibliog- 
raphy to be published in Fall, 1977). 


Pyhrr, Peter A., Zero Base Budgeting: A Practical 
Management Tool for Evaluating Expenses, Wiley, 
New York, 1973. 


This book is considered to be a valuable reference 
by those managers who are interested in the appli- 
cation of ZBB to their operations. 


Research and Policy Committee of the Committee 
for Economic Development, Improving Productiv- 
ity in State and Local Government. Committee for 
Economic Development, March, 1976. 


This publication encourages the better manage- 
ment of resources rather than focusing on input and 
output. It discusses areas that are amenable to im- 
provements in management and Federal-State re- 
sponsibility in this area. 


Robinson, A.J., Economic Evaluation of Munict- 
pal Expenditures: PPB, Canadian Tax Papers No. 
52, Canadian Tax Foundation, Toronto, March, 
1271, 


Following a brief introduction outlining the history 
of urbanization in Canada and the role of munici- 
pal government, the author provides a description 
of PPB as a system for municipal government. To- 
pics in this section include; definition of a program, 
objectives of municipal government, the place of 
objectives in PPB, incremental budgeting and pps, 
and multi-year budgeting. In discussing these to- 
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pics, the author provides numerous examples from 
municipalities which have used the system, particu- 
larly New York City and the 5-5-5 Project Cities. 
The final section is concerned with how to imple- 
ment PPB. 


Ross, J.P., and Burkhead, J., Productivity in the 
Local Government Sector, Lexington Books — 
D.C. Heath and Company, Lexington, 1974. 


The overall goal of this lengthy study is to provide a 
means for answering questions about performance 
in local government. The mathematical model de- 
veloped in this work provides such a technique. 
Results of the study indicate low rates of productiv- 
ity growth for a number of local government func- 
tions. Recommendations for future action are 
made. 


Schainman, P.S., and Swartz, J., Measuring Fire 
Protection Productivity in Local Government, Na- 
tional Fire Protection Association, Boston, Mass., 
October, 1974. 


Problems in measuring productivity in local fire 
protection and prevention are explored. An ap- 
proach to making meaningful measurements Is pre- 
sented. 


Schick, Allen, ‘A Death in the Bureaucracy: The 
Demise of Federal prs’, Public Administration Re- 
view, March/April, 1973, pp. 146-156. 


Discusses the many reasons why PPB failed in the 
u.s. Federal Government and the effect its disap- 
pearance would have in the future. Primary among 
the reasons for failure was the method of im- 
plementation which was quick, across-the-board 
and with little or no consideration given to budget 
traditions, institutional loyalties or personal rela- 
tionships. 


Segsworth, R.V., ‘ppps and Policy Analysis: The 
Canadian Experience’, International Review of 
Administrative Sciences, Vol. 38, 1972, pp. 
419-425. 


Covers the history of PPB in Canada — The Glassco 
Report and its effects at the federal level. 


Skok, James E., Second Generation Adaptations of 
the Planning-Programming - Budgeting System in 
Pennsylvania, Prepared for presentation at the 
1976 National Conference, American Society for 
Public Administration, Washington, D.c., April 
19-22, 976. 


This article reports the results of a study to deter- 
mine and identify those aspects of PPB systems 
which are successful and the conditions associated 
with this success. Study evaluates the experiences of 
the Commonwealth of Pennsylvania with the pps 
system. 


Social Science Research Council, Centre for Social 
Indicators, Social Indicators Newsletter, No. 10, 
September, 1976. 
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Newsletter reporting on developments in the area 
of social indicators. In this issue articles include 
discussion on cohort analysis, influences in social 
reporting in Germany, Austria, and Switzerland. 
Newsletter also provides reports on books dealing 
with social indicators. 


State Department of Urban Affairs, Stage Report of 
EVAM Project, Ottawa, April, 1973. 


Aninterim report of a study being conducted in the 
Province of Quebec into municipal indicators. 


Sterns, A.A., ‘Management Accounting for Gov- 
ernment’, Costand Management, December, 1967, 
pp. 20-23. 


This short article outlines the limitations of the old 
system of planning and controlling of government 
expenditures in Canada and the u:s. that led up to 
the Glassco Commission’s recommendations for 
administrative reform. 


Teitz, Michael B., ‘Cost Effectiveness: A Systems 
Approach to Analysis of Urban Services’, Journal 


of the American Institute of Planners, September, 
1968, pp. 303-311. 


Discusses the problems involved in using PPB at the 
local level, particularly the difficulties of setting 
objectives. Presents a model of systems analysis 
applicable to municipal services. Also discusses 
cost effectiveness, a measure which relates output 
to the achievement of objectives without necessar- 
ily describing output in terms of dollars. 


Wallace, Robert J., Occasional Paper No. 26, Pro- 
ductivity and the Fire Service, Metropolitan Studies 
Program, Maxwell School of Citizenship and Pub- 
lic Affairs, Syracuse University, December, 1975. 


This paper explores the problems encountered in 
measuring the productivity of the fire service. A 

review of the previous attempts at fire safety pro- 
ductivity measurement is made and the author sug- 
gests alternative measures of fire service productiv- 
ity. 


Webb, Kenneth and Hatry, Harry P., Obtaining 
Citizen Feedback: The Application of Citizen Sur- 
veys to Local Government, The Urban Institute, 
Washington, D.c., 1973. 


This book deals with the use of citizen surveys, one 
of the major recent advances in measuring local 
government performance. The authors describe 
several uses of citizen surveys and point out the 
dangers and pitfalls involved. Further chapters dis- 
cuss survey procedures, costs and funding sources, 
organizational options for undertaking surveys and 
conclusions and recommendations. Several exam- 
ples of citizen surveys are provided as illustrations. 


Wholey, Joseph S., ‘What Can We Actually Get 
From Program Evaluation?’ Policy Sciences 3, 
Elsevier Scientific Publishing Company, Amster- 
dam, 1972, pp. 361-369. 
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This paper assesses the role program evaluation can 
play in assisting decisions on public programs. The 
author looks at evaluation from the standpoint of 
decision-makers interested in finding out the ‘right’ 
answers about their programs. The discussion fo- 
cuses on the assistance that various types of evalua- 
tion can give to program managers and to policy- 
makers concerned with legislative changes and 
budget levels. The paper includes examples of re- 
levant evaluation work. The concluding section 
analyzes some of the problems decision-makers 
face in trying to get reliable, useful evaluation. 


Wilcox, Leslie D., Brooks, Ralph M., Beal, George 
M., and Klonglan, Gerald E., Social Indicators and 
Societal Monitoring: An Annotated Bibliography, 
Jossey-Bass Inc., San Francisco- Washington, 1972. 


This book provides an annotated bibliography of 
articles, books, etc. dealing with the areas of social 
planning and societal monitoring. Four separate 
indices are provided to aid the reader in locating 
articles of interest. 


Wildavsky, A., and Hammond, A., ‘Comprehen- 
sive versus Incremental Budgeting in the Depart- 


ment of Agriculture’, Administrative Science Quar- 
terly: 10, 1965, pp. 321-346. 


Article describes and evaluates the introduction of 
zero based budgeting in the Department of Agricul- 
ture. The problems that were encountered with the 
change over from line budget to zero based budget 
are well outlined. 


u.s. Dept. of Labor, The Meaning and Measure- 
ment of Productivity, Bulletin 1714, Bureau of 
Labor Statistics, 1971. 


Two papers prepared as background material for 
members of the National Commission on Produc- 
tivity. The first by Herbert Stein is concerned with 
clarifying what is meant by productivity, and why it 
isimportant. The second paper, by Jerome A. Mark 
is concerned with concepts and measures of pro- 
ductivity. Output, labour input and capital input 
are explained, and problems of measurement dis- 
cussed. Various recommendations are also made. 
Charts are included. 


Publications by the Treasury Board of Canada 


64 Andras, R. Hon., President of the Treasury Board 


of Canada, Progress Report on the Measurement of 
Performance in the Public Service of Canada, 
November, 1976. 


Reviews the development of the performance 
measurement concept within the federal govern- 
ment departments, including its introduction, cur- 
rent status and future directions. Examples include 
the Unemployment Insurance Commission, the 
Departments of Consumer and Corporate Affairs, 
Post Office, Public Works, Revenue, Supply and 
Services, Veterans Affairs, and Health and Welfare. 


65 Andras, R. Hon., President of the Treasury Board 
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of Canada, Performance Measurement in the Pub- 
lic Service of Canada, Statement made in the House 
of Commons, November 17, 1976. 


Re-affirms the government’s intention to introduce 
performance measurement in the Federal Public 
Service. Outlined are the goals of the program, the 
benefits expected and the limits of the concept. 


Mastronardi, E.J., The Measurement of Opera- 
tional Performance, Efficiency Evaluation Divi- 


sion, Planning Branch, Treasury Board Secretariat, 
June, kez. 


A discussion of measures of effectiveness relating 
both to ppB and MBO. Mostly presented in chart 
form, this paper covers the area of measuring effec- 
tiveness very well. 


Osbaldeston, G.F., Evaluation of Public Programs: 
A Treasury Board Viewpoint, March 29, 1974. 


Developments in the Federal Public Service are dis- 
cussed, including Planning Programming Budget- 
ing System, OPMS, benefit cost analysis, and 
strategic planning. The author discusses how each 
of these ongoing activities fits together in the man- 
agement of the public sector. 


The Treasury Board, Planning Branch — Per- 
formance Measurement Policy Division, A 
Manager’s Guide to Performance Measurement, 
October, 1976. 


This booklet describes the concepts upon which 

performance measurement in the federal govern- 
ment is based. Examples are drawn from the De- 
partments of Health and Welfare, Revenue and the 
National Capital Commission. The examples show 
how savings have been achieved in the cost of pro- 
viding essential government services. 


The Treasury Board, Operational Performance 
Measurement: Volume I, A Managerial Overview, 
Ottawa, January, 1974. 


The purpose of this publication is to describe a 
comprehensive system for the measurement of op- 
erational performance. The Operational Perfor- 
mance Management System (opMs) deals with: 


a comparing efficiency and effectiveness over 
time; 

b predicting future resource requirements on the 
basis of the forecast output, and past and current 
levels of efficiency; and 

c assessing the quantitative dimensions of mana- 
gerial performance. 


This manual serves as a technical reference work 
which provides detailed information on the 
principles, procedures, and processes associated 
with OPMS. 
The Treasury Board, Operational Performance 
Measurement: Volume 2, Techniques, Ottawa, 
1974. 
A more technical treatment of OPMS, this publica- 


ay 


tion analyzes considerations of design, implemen- 
tation, and maintenance of such a system. (This 
volume is meant to be read following the Treasury 
Board’s, Operational Performance Measurement, 
Volume I.) 


Publications by the Urban Institute 


The Urban Institute has produced a great many essays, 
studies and papers on productivity in the public sector. 
Some are listed below. An up-to-date bibliography of 
Urban Institute publications can be obtained from the 
Institute’s Publications Catalog 1977. This also in- 
cludes a section on forthcoming publications. 
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Block, Peter B., Equality of Distribution of Police 
Services: A Case Study of Washington, D.C., The 
Urban Institute, Washington, D.c., February, 
1974. 

A study comparing the equality of police service in 
two sections of the District of Columbia, one pre- 
dominantly black and poor, the second white and 
affluent. Measures used in evaluation include 
workload measures and effectiveness measures. 


The implication of the study is that citizen surveys 


can be used as a method of discerning the effective- 
ness of police services. 


Block, Peter B., and Specht, David I., Evaluation of 
Operation Neighbourhood, The Urban Institute, 
Washington, D.c., December, 1973. 


An evaluation of neighbourhood team policing in 
New York City is presented. Workload, effective- 
ness and citizen input measures are used to evaluate 
this concept, as well as the opinions of the police 
officers. 


Fisk, Donald M., The Indianapolis Police Fleet 
Plan: An Example of Program Evaluation for 
Local Government, The Urban Institute, Washing- 
ton, D.c., October, 1970. 


A case history involving a police department is 
outlined, describing the steps taken, the evaluation 
used and the results achieved. 


Fisk, Donald M., Hatry, Harry P., and Kimmell, 
Wayne A., Practical Program Analysis for Local 
Governments, The Urban Institute, Washington, 
Bc, October, 1972. 


The report opens with a discussion of ‘institutional’ 
issues which may substantially affect the utility of 
program analysis and makes recommendations on 
practical ways to develop and use analysis within 
the constraints of government. The report discusses 
the role of the chief executive and urges that analyt- 
ical work be linked directly to the policy-making 
process. to ensure that analysis is done on major 
policy issues which count. Criteria for selecting 
issues for analysis are presented; scheduling and 
monitoring analytical work is suggested; the ele- 
ments of a formal issue selection and analysis are 
discussed; and suggestions for larger jurisdictions 
are identified. Staffing and organizing for analysis 
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is discussed, and suggestions are made for using 
internal and outside analytical resources to best 
advantage. Case study findings are presented on the 
major factors which seem to affect the impact of 
analysis on policy. 


Fisk, Donald M., Schainnman, P.S., and Hatry, H., 
Comparative Productivity Analysis of Local Gov- 
ernments: Some Findings and an Agenda for Future 
National Efforts, The Urban Institute, Washing- 

ton, D.c., November, 1972. 


The final report of a study designed to investigate 
local government productivity. The basic questions 
to which it addresses itself concern the possibility of 
improvement of local government productivity 
data bases. The findings of the report form the basis 
for recommendations to the Department of Hous- 
ing and Urban Development. 


Fisk, Donald M., and Lancer, Cynthia A., Equality 
of Distribution of Recreation Services: A Case 
Study of Washington, D.C., The Urban Institute, 
Washington, D.c., 1974. 


Addresses the question of whether two geographic 
areas of Washington, D.C., receive equal recreation 
treatment. The authors develop a methodology ap- 
plicable to comparing public recreation services. 


Hatry, Harry P., Overview of Modern Program 
Analysis Characteristics and Techniques - Modern 
Program Analysis - Hero or Villain?, Urban Insti- 
tute Reprint from National Association of State 
Budget Officers, Council of State Government, 
262: 


Two papers which deal with program analysis. The 
first distinguishes between program analysis, prog- 
ram budgeting and pps and reviews the basic ele- 
ments of analysis. The second paper explores relev- 
ant applications of program analysis, identifies 
some dangers involved and suggests ways and 
means of improving program analysis. 


Hatry, Harry P., Can Systems Analysis be In- 
stitutionalized in Local Government, The Urban 
Institute, (reprint), Washington, D.c., 1970. 


A paper urging the regular use of systems analysis 
in local government. The need for systems analysis 
is outlined and barriers to its institutionalization 
pointed out. The status of systems analysis in local 
government is summarized and the role of PPB exp- 
lored. Finally some conclusions and recommenda- 
tions are offered. 


Hatry, H.P., Blair, L., Fisk, D., Kimmell, W.A., 
Program Analysis for State and Local Govern- 


ments, The Urban Institute, Washington, D.C., 
L976; 


This is a companion report to Practical Program 
Evaluation for State and Local Government Offi- 
cials. This book outlines a systematic approach to 


estimating both the costs and effectiveness of future 
state and local programs. 
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cal Program Evaluation for State and Local Gov- 
ernment Officials, The Urban Institute, Washing- 
fom DG, L973. 


A report designed to help public officials develop or 
improve their program evaluation capabilities. 
Contains concrete practical suggestions as to how 
to identify specific program objectives, outlines 
criteria for measuring progress towards these ob- 
jectives and identifies the population segments that 
are likely to be affected by the program. 


Kimmell, W.A., Dougan, W.R., and Hall, J.R., 
Municipal Management and Budget Methods: An 
Evaluation of Policy Related Research, Final Re- 
port, Volume I: Summary and Synthesis, The 
Urban Institute, Washington, D.c., December, 
1974. 


This important volume describes and evaluates the 
utility and effectiveness of management and budget 
methods available for use by municipal govern- 
ments. Among those discussed are, management by 
objectives, program evaluation, systems, program 
and policy analysis, program budgeting, perfor- 
mance budgeting, planning programming budget- 
ing systems, service effectiveness measurement, 
community goals studies. Each of these topics is 
supplemented with its own bibliography. 


Search - A Report from the Urban Institute, Vol. 5, 
INasi-2, opring..197 5. 


Report contains brief articles about Urban Institute 
research activities, and identifies staff and publica- 
tions associated with the research. In this report the 
efforts of the City of Orange and Flint, Michigan, 
are evaluated. 


Webb, Kenneth and Hatry, Harry P., Obtaining 

Citizen Feedback: The Application of Citizen Sur- 
veys to Local Governments, The Urban Institute, 
Washington, D.c., 1973. 


In this publication the authors present their case for 
using surveys as animportant mechanism by which 
governments may obtain feedback on public ser- 
vice. Included is a description of the use to which 
surveys may be put, how to survey, the dangers and 
pitfalls in citizen surveys and recommendations for 
governments who are contemplating this route. 


Wholey, Joseph S., The Absence of Program 
Evaluation as an Obstacle to Effective Public Ex- 
penditure Policy: A Case Study of Child Health 
Care Programs, The Urban Institute, (Reprint), 
Washington, D.c., undated. 


The author presents a case study of an attempt to 
apply pps analysis to child health care programs. 
He points out a major weakness in the PPB system 
and offers some recommendations for improving 
the economic evaluation of government’s social 
programs. 


Winnie, Richard E., and Hatry, Harry P., Measur- 
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ing the Effectiveness of Local Government Ser- 
vices: Transportation, The Urban Institute, 
Washington, D.c., 1972. 


A document intended to aid officials involved in 
determining the quality of local transportation ser- 
vices being provided. Proposed is a system of estab- 
lishing transportation objectives and effectiveness 
measures. Examples are given of effectiveness 
measures that are intended to apply to all modes of 
transportation. A significant portion of the publi- 
cation describes procedures whereby data may be 
collected for each of the effectiveness measures de- 
sired. 


Young, Dennis R., How Shall We Collect the Gar- 
bage? A Study in Economic Organization, The 
Urban Institute, Washington, D.c., 1972. 


Intended primarily for local officials, this docu- 
ment questions the organization of garbage collec- 
tion and offers recommendations to overcome the 
present situation. The case is made that garbage is 
becoming big business and that new changes in the 
organization of refuse collection must be forthcom- 
ing to protect the public interest and to improve the 
performance of this industry. 


The Urban Institute and the International City 
Management Association, Measuring the Effec- 
tiveness of Basic Municipal Services: Initial Report, 
The Urban Institute and the International City 
Management Association, February, 1974. 


A report on a project undertaken jointly by the 
Urban Institute and the 1cMa in St. Petersburg, 
Florida and Nashville-Davidson, Tennessee. The 
project involves a comprehensive effort to imple- 
ment an extensive performance measurement and 
evaluation system in the two municipalities. The 
report is written for the benefit of other local gov- 
ernment administrators and provides a number of 
measures and measurement techniques which may 
be used. 


The Urban Institute, The Status of Productivity 
Measurement in State Government: An Initial Ex- 
amination, Washington, D.C., September, 1975. 


This report studies the availability of feedback in- 
formation on municipal operations. Consistently, 
this information was sparse. The study was under- 
taken with the co-operation of the National As- 
sociation of State Budget Officers and consequently 
economic development measures were stressed. 


Publications by the National Commission on 
Productivity 
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National Commission on Productivity, A National 
Policy for Productivity Improvement, Washington, 
D.C. Octoper, L975, 


A statement by the Commission members of NCOP 
regarding their current thinking on national pro- 
ductivity policy. Covered by this report are, pro- 
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ductivity and the internal interest, human re- 
sources, technology capital investment and gov- 
ernment regulations. 


Hatry, Harry.,etal., The Challenge of Productivity 
Diversity: Improving Local Government Produc- 
tivity Measurement and Evaluation, Report pre- 
pared for the National Commission on Productiv- 
ity and Work Quality, the Urban Institute and the 
International City Management Association, 
Washington, D.c., June, 1972. 


A four volume study covering the area of perfor- 
mance measurement and evaluation in general and 
focusing in particular on the areas of solid waste 
collection and crime control. Much of the more 
recent research and several of the projects of the 
Urban Institute and the 1cMA are based on this 
study. 


National Commission on Productivity and Work 
Quality, Employee Incentives to Improve State and 
Local Government Productivity, Washington, 
p.c., March, 1975. 


A broad view of incentive programs across the 
United States is provided. Particular areas addres- 
sed include: attendance incentives, career de- 
velopment, competitions and contests, educational 
incentives, job enlargement, performance bonuses, 
productivity bargaining, work standards, etc. This 
publication represents the most comprehensive 
survey to date in the incentives area. 


The National Commission on Productivity and 
Quality of Working Life, Jurisdictional Guide to 
Productivity Improvement Projects, 3rd ed., Pre- 
pared by the International City Management As- 
sociation, Washington, D.c., July, 1976. 


A variety of local governments have experimented 
with productivity improvement in several opera- 
tional areas. This report presents information on a 
large number of productivity improvement prog- 
rams embracing a wide spectrum of methods im- 
plemented by local governments throughout the 
United States. The projects listed are grouped under 
the following headings: energy conservation, gen- 
eral administration, inspections, library service, 
parks and recreation, public health, public safety, 
public transit, and public works. This publication is 
one in a series, updated annually. In the future it 
will be published by 1cMa and distributed on a 
subscription basis. 


National Commission on Productivity, Improving 
Municipal Productivity: The Detroit Refuse Col- 
lection Incentive Plan, Washington, D.C., April, 
1974. 


The background, history, and progress of the De- 
troit refuse collection productivity improvement 
plan presented in a short case study format. 


National Commission on Productivity and Work 
Quality, Improving Municipal Productivity: Work 
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Measurement for Better Management, Washing- 
ton, D.c., November, 1975. 


This report describes analytical techniques used for 
methods improvement and work measurement. It 
contains numerous illustrations of how these tech- 
niques have been applied to enhance efficiency in 
local government. 


National Commission on Productivity, Improving 
Police Productivity: More for your law enforce- 
ment dollar. A brief for elected officials, Washing- 
ton, D.C., undated. 


A pamphlet outlining key questions that elected 
officials should ask when considering police pro- 
ductivity. Based on the findings of the National 
Commission on Productivity’s Advisory Group on 
Productivity in Law Enforcement, the pamphlet is 
written in a clear and simple style. 


Hatry, H.P., and Fisk, D.M., Improving Productiv- 
ity and Productivity Measurement in Local Gov- 
ernment, A report for the National Commission on 
Productivity, The Urban Institute, Washington, 
Dice lime oa 


Discusses reasons for productivity analysis, major 
technical problems, current measurement methods 
and possibilities for improvement. 


National Commission on Productivity, Improving 
Productivity in Solid Waste Collection: A Brief for 
Elected Officials, Washington, D.c., undated. 


A pamphlet written for elected officials, outlining 


key questions now facing municipalities regarding 
this service. 


National Commission on Productivity and Work 
Quality, Labour-Management Committees in the 
Public Sector, Washington, D.c., November, 1975. 


This report deals with the experiences of eight 

labour management committees which have been 
operating in various local and Federal Government 
agencies in the u.s. The report deals primarily with 


committees’ handling of productivity improvement 
issues. 


National Commission on Productivity, Managing 
Human Resources in Local Government: A Survey 
of Employee Incentive Plans, The Urban Institute, 
Washington, D.c., October, 1973. 


The purpose of this survey was to describe a variety 
of employee incentives being attempted in local 
governments throughout the u.s. Guidelines are 
offered for expanding these applications to other 
areas and criteria are provided for evaluating the 
effectiveness of such incentives. 


100 National Commission on Productivity, Oppor- 


tunities for Improving Productivity in Police Ser- 
vices, Report of the Advisory Group on Productiv- 
ity in Law Enforcement, Washington, D.c., 1973. 


Advisory group composed of police adminis- 


trators, criminal justice planners, academics, etc. 
Report considers productivity in context of police 
services, productivity in patrol, crime prevention 
programs, managing human resources, and bar- 

riers to productivity improvement. A bibliography 
is also included. 


101 National Commission on Productivity, Oppor- 


tunities for Improving Productivity in Solid Waste 
Collection, Report of the Solid Waste Management 
Advisory Group, Washington, D.c., 1973. 


Report of advisory group made up of public works 
directors, municipal officials, labour leaders, etc. 
Considers the potential for productivity improve- 
ment, measuring collection productivity, principal 
collection problems, tools for improving productiv- 
ity, and actions to improve productivity. A list of 
references is included. 


102 National Commission on Productivity and Work 


Quality, Productivity Centers around the World, 
Washington, D.c., May, 1975. 


Publication describing the role, history, function 
and organization of productivity centers. 
Throughout much of the industrialized world, 
countries have established ‘productivity’ centers to 
encourage new developments in improving produc- 


tivity. 


103 National Commission on Productivity, Public Sec- 


tor Labor Management Committee: A Case Study, 
Washington, D.c., undated. 


Brief publication reporting on the efforts ofa labor 
management committee at the Defense Supply 
Agency’s organization at Mechanicsburg, Pennsyl- 
vania. Presented is the background to the agree- 
ment, control clauses on productivity, and the first 
year results. 


104 National Commission on Productivity and Work 


Quality, The Role of Productivity in Controlling 
Inflation, Washington, D.c., December, 1974. 


This short paper relates the contribution of produc- 
tivity improvement to the contemporary inflation 
problem and reviews the current causes of infla- 
tion. 


105 National Commission on Productivity and Work 


Quality, So Mr. Mayor, You Want to Improve 
Productivity ..., Washington, D.c., 1974. 


A primer on why local governments need produc- 
tivity improvement programs and how a mayor 
should go about setting up and running such a 
program. 
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Appendix III 
Project Publications 


The investigations required for the design of this Project 
have led to some publications and working papers. As 
the Project proceeds and develops over the four years, 
additional publications will be forthcoming - orig- 
inating from the Project Team at the School of Business, 
Queen’s University at Kingston. These publications will 
be available for purchase on the publication date indi- 
cated on the attached order form. Orders should be sent 
to the Ontario Government Publication Centre, Minis- 
try of Government Services, 3B-7 MacDonald Block, 
Queen’s Park, Toronto, Ontario, M7A 1N8. 


Apart from the Project Overview Statement, the vari- 
ous publications have been grouped into four series. 


PROJECT OVERVIEW STATEMENT 


This paper describes the Project in overview fashion. It 
contains a statement of the goal and objectives of the 
Project, a description of the goal and objective setting 
process, and the documentation and evaluation proces- 
ses to be used in the study. Price $1.00. 


SERIES A PUBLICATIONS: PROJECT 
DOCUMENTATION AND EVALUATION 


The purpose of this series of papers is to describe the 
experiences of the four Project Municipalities, to 
analyse those experiences, and to indicate their possible 
relevance to other municipalities. This series will also 
include papers outlining the design of the evaluation 
process, as well as periodic reports on the evaluation of 
the Project. 

1 The LGMP Experience: Phase I. This paper traces 
the Project from its inception in 1972 through vari- 
ous approval stages ending with the approval of the 
Project by each of the four participating munici- 
palities. Price $2.00. 


2 The LGMP Experience: Phase II. This paper traces 
the Project through its early implementation stages, 
ending at the termination of the second full year of 
funding. Price $3.00. 


3 The LGMP Experience: Phase III. This paper con- 
cludes the detailed story of the Project, ending witha 
summary of recommendations for other munici- 
palities. Price $3.00. 


4 The LGMP Experience: The LGMP and Organiza- 
tional Change: This final publication will include an 
overall perspective on the LGMP and an evaluation of 
the total experience. The analysis section, in this 
case, will be an analysis of the complete project and 
the paper will end with a section on the broad impli- 
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cations of similar major programs of organizational 
change for other local government organizations. 
Price $4.00. 


5 The LGMP Experience: Guidelines for Organiza- 
tional Change in Local Government. As they iden- 
tified requirements for management improvement, 
the Project Team attempted to meet training needs 
and developed working papers explaining the proce- 
dures they had used. In total, these working papers, 
which have been edited and included in one publica- 
tion, provide a framework or guide for various as- 


pects of organizational change in local government. 
Price $4.50. 


SERIES B PUBLICATIONS: TECHNICAL PAPERS 


The purpose of this series of papers is to present reason- 

ably concise descriptions of broad areas of municipal 
management and administration as they relate to vari- 
ous aspects of the Project. These papers, which describe 

the state of practice and experimentation of the various 

areas, have been written for elected and appointed local 
government officials. 


1 Determining Goals for Local Government. This 
paper examines the planning process and its con- 
tribution to local government at both management 
and policy levels. It outlines the role of goals and 
objectives within planning and stresses its impor- 
tance as an on-going adaptive process. Annotated 
bibliography. Price $3.00. 


2 Improving Management Performance. An examina- 
tion of the topic of performance measurement em- 
phasizing managerial performance, including exam- 
ples of indicators in use in a number of 
municipalities. Annotated bibliography. Price $5.00. 


3 Organizational Change in Local Government. This 
paper describes the general field of organizational 
development in municipalities and summarizes the 
experiences of two municipalities. Annotated bib- 
liography. Price $3.00. 


4 Systematic Approaches to Information in Local 
Government. An examination of the general field of 
information systems and a suggested approach to the 
systematic development and use of information in 


local government. Annotated bibliography. Price 
$3.00. 


SERIES C PUBLICATIONS: CASE STUDIES 


The purpose of this series is to describe various munici- 
pal experiences with programs related to the goal and 


objective setting process. The case studies are suitable 
for instructional purposes to focus discussion on the 
broad areas which the cases represent. 


1 


Goals for Dallas ‘A’. The Dallas, Texas experience 
with broad goal setting, involving extensive public 
participation. The ‘A’ case reviews the program from 
its inception in 1965S to 1972. Price $2.00. 


Goals for Dallas ‘B’. The Dallas, Texas experience 
with broad goal setting, involving extensive public 
participation. The ‘B’ case examines the program 
from 1972 to 1974. Price $2.00. 


SERIES D PUBLICATIONS: PERIODIC PAPERS 


The purpose of these papers is to describe various as- 
pects of the Project which are felt to be of interest to 
municipalities contemplating the introduction of a sys- 
tem of goals and objectives. 


1 Developments in the Management of Local Gov- 


ernment — A Review and Annotated Bibliography. 
This paper was prepared to provide local govern- 
ment managers and elected representatives with a 
description of current developments in the field of 
local government. The paper describes ten areas of 
development in the management of local govern- 
ment and supplies annotated bibliographies of 
books, articles and reports dealing with these areas. 
Bricesp2.00: 
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Local Government 
Management Project 


Publication 
Order 


Form 


This order form can be used to order publications of the Local Government Management Project. Orders can be made 
as the publications become available as indicated by the date of publication. Enclose payment with this order form. 


Make cheques payable to Treasurer of Ontario. 
Orders should be forwarded to: 


Ontario Government Publications Centre 
Ministry of Government Services 

3B-7 MacDonald Block 

Queen’s Park 

Toronto, Ontario 

M7A 1N8 


Publication 
Publication Title Date 


Project Overview Statement Dec. 1974 


Series A Publications: 
Documentation and Evaluation 
The LGMP Experience: 
Phase I fan 


The LGMP Experience: 
Phase II 


The LGMP Experience: 
Phase III 


The LGMP Experience: 
The LGMP and Organi- 
zational Change Mar. 1978 


The LGMP Experience: 

Guidelines for Organi- 

zational Change in 

Local Government Ape. 1977 


Dec. 1977 


Feb. 1978 


Series B Publications: Technical Papers 
Determining Goals 
for Local Government Dec. 1977 


Improving Management 
Performance Nov. 1977 


Organizational Change in 
Local Government Mar. 1978 


Systematic Approaches to 
Information in 


Local Government Feb. 1978 


Series C Publications: Case Studies 
Goals for Dallas ‘A’ 
Goals for Dallas ‘B’ 


May 1975 
May 1975 


Series D Publications: Periodic Papers 
Developments in the Management 
of Local Government — A Review 


and Annotated Bibliography Deail975 


TOTAL ORDER 


$4.00 


$4.50 
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at Kingston Intergovernmental 
Ontario Affairs 
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